2023-03-28 05:53:32,701 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-28 05:53:32,963 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f 2023-03-28 05:53:32,979 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-28 05:53:32,979 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4, deleteOnExit=true 2023-03-28 05:53:32,979 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-28 05:53:32,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/test.cache.data in system properties and HBase conf 2023-03-28 05:53:32,980 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/hadoop.tmp.dir in system properties and HBase conf 2023-03-28 05:53:32,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/hadoop.log.dir in system properties and HBase conf 2023-03-28 05:53:32,981 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-28 05:53:32,982 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-28 05:53:32,982 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-28 05:53:33,100 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-28 05:53:33,532 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-28 05:53:33,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-28 05:53:33,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-28 05:53:33,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-28 05:53:33,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-28 05:53:33,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-28 05:53:33,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-28 05:53:33,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-28 05:53:33,539 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-28 05:53:33,540 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-28 05:53:33,540 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/nfs.dump.dir in system properties and HBase conf 2023-03-28 05:53:33,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/java.io.tmpdir in system properties and HBase conf 2023-03-28 05:53:33,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-28 05:53:33,541 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-28 05:53:33,542 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-28 05:53:34,101 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-28 05:53:34,106 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-28 05:53:34,421 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-28 05:53:34,597 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-28 05:53:34,611 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-28 05:53:34,650 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-28 05:53:34,684 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/java.io.tmpdir/Jetty_localhost_35083_hdfs____ffosoj/webapp 2023-03-28 05:53:34,831 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35083 2023-03-28 05:53:34,849 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-28 05:53:34,849 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-28 05:53:35,442 WARN [Listener at localhost/44787] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-28 05:53:35,550 WARN [Listener at localhost/44787] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-28 05:53:35,572 WARN [Listener at localhost/44787] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-28 05:53:35,579 INFO [Listener at localhost/44787] log.Slf4jLog(67): jetty-6.1.26 2023-03-28 05:53:35,584 INFO [Listener at localhost/44787] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/java.io.tmpdir/Jetty_localhost_46507_datanode____.huue3j/webapp 2023-03-28 05:53:35,686 INFO [Listener at localhost/44787] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46507 2023-03-28 05:53:36,083 WARN [Listener at localhost/33463] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-28 05:53:36,628 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x57f0a2e464353c13: Processing first storage report for DS-8b266ab6-672e-4bb8-b73d-e2191b457145 from datanode 4c8d19b4-f876-4384-9144-a38ed36d5b8c 2023-03-28 05:53:36,629 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x57f0a2e464353c13: from storage DS-8b266ab6-672e-4bb8-b73d-e2191b457145 node DatanodeRegistration(127.0.0.1:44025, datanodeUuid=4c8d19b4-f876-4384-9144-a38ed36d5b8c, infoPort=40945, infoSecurePort=0, ipcPort=33463, storageInfo=lv=-57;cid=testClusterID;nsid=1337497521;c=1679982814185), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-28 05:53:36,629 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x57f0a2e464353c13: Processing first storage report for DS-9bb162bf-0f2a-41dc-9587-a982ebc5f2fc from datanode 4c8d19b4-f876-4384-9144-a38ed36d5b8c 2023-03-28 05:53:36,629 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x57f0a2e464353c13: from storage DS-9bb162bf-0f2a-41dc-9587-a982ebc5f2fc node DatanodeRegistration(127.0.0.1:44025, datanodeUuid=4c8d19b4-f876-4384-9144-a38ed36d5b8c, infoPort=40945, infoSecurePort=0, ipcPort=33463, storageInfo=lv=-57;cid=testClusterID;nsid=1337497521;c=1679982814185), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-28 05:53:36,662 DEBUG [Listener at localhost/33463] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f 2023-03-28 05:53:36,730 INFO [Listener at localhost/33463] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4/zookeeper_0, clientPort=58236, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-28 05:53:36,744 INFO [Listener at localhost/33463] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58236 2023-03-28 05:53:36,753 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:36,755 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:37,445 INFO [Listener at localhost/33463] util.FSUtils(471): Created version file at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de with version=8 2023-03-28 05:53:37,445 INFO [Listener at localhost/33463] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/hbase-staging 2023-03-28 05:53:37,779 INFO [Listener at localhost/33463] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-28 05:53:38,296 INFO [Listener at localhost/33463] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-03-28 05:53:38,328 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-28 05:53:38,328 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-28 05:53:38,328 INFO [Listener at localhost/33463] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-28 05:53:38,328 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-28 05:53:38,329 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-28 05:53:38,480 INFO [Listener at localhost/33463] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-28 05:53:38,576 DEBUG [Listener at localhost/33463] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-28 05:53:38,682 INFO [Listener at localhost/33463] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35293 2023-03-28 05:53:38,695 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:38,698 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:38,725 INFO [Listener at localhost/33463] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35293 connecting to ZooKeeper ensemble=127.0.0.1:58236 2023-03-28 05:53:38,770 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:352930x0, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-28 05:53:38,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35293-0x10129af578b0000 connected 2023-03-28 05:53:38,800 DEBUG [Listener at localhost/33463] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-28 05:53:38,801 DEBUG [Listener at localhost/33463] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-28 05:53:38,805 DEBUG [Listener at localhost/33463] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-28 05:53:38,817 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35293 2023-03-28 05:53:38,817 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35293 2023-03-28 05:53:38,818 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35293 2023-03-28 05:53:38,824 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35293 2023-03-28 05:53:38,824 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35293 2023-03-28 05:53:38,830 INFO [Listener at localhost/33463] master.HMaster(444): hbase.rootdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de, hbase.cluster.distributed=false 2023-03-28 05:53:38,905 INFO [Listener at localhost/33463] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-03-28 05:53:38,905 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-28 05:53:38,905 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-28 05:53:38,905 INFO [Listener at localhost/33463] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-28 05:53:38,905 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-28 05:53:38,906 INFO [Listener at localhost/33463] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-28 05:53:38,910 INFO [Listener at localhost/33463] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-28 05:53:38,913 INFO [Listener at localhost/33463] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39167 2023-03-28 05:53:38,916 INFO [Listener at localhost/33463] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-28 05:53:38,923 DEBUG [Listener at localhost/33463] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-28 05:53:38,924 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:38,927 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:38,928 INFO [Listener at localhost/33463] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39167 connecting to ZooKeeper ensemble=127.0.0.1:58236 2023-03-28 05:53:38,932 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:391670x0, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-28 05:53:38,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39167-0x10129af578b0001 connected 2023-03-28 05:53:38,933 DEBUG [Listener at localhost/33463] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-28 05:53:38,934 DEBUG [Listener at localhost/33463] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-28 05:53:38,935 DEBUG [Listener at localhost/33463] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-28 05:53:38,936 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39167 2023-03-28 05:53:38,936 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39167 2023-03-28 05:53:38,936 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39167 2023-03-28 05:53:38,937 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39167 2023-03-28 05:53:38,939 DEBUG [Listener at localhost/33463] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39167 2023-03-28 05:53:38,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:38,951 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-28 05:53:38,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:38,972 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-28 05:53:38,972 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-28 05:53:38,973 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:38,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-28 05:53:38,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35293,1679982817593 from backup master directory 2023-03-28 05:53:38,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-28 05:53:38,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:38,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-28 05:53:38,979 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-28 05:53:38,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:38,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-28 05:53:38,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-28 05:53:39,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/hbase.id with ID: 8af3f01d-d5e1-4983-b2e8-adc1b4385b43 2023-03-28 05:53:39,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:39,136 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:39,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0a840b53 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:53:39,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@113e7d4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:53:39,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-28 05:53:39,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-28 05:53:39,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-28 05:53:39,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-28 05:53:39,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-28 05:53:39,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-28 05:53:39,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-28 05:53:39,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store-tmp 2023-03-28 05:53:39,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:39,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-28 05:53:39,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:53:39,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:53:39,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-28 05:53:39,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:53:39,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:53:39,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-28 05:53:39,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/WALs/jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:39,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35293%2C1679982817593, suffix=, logDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/WALs/jenkins-hbase4.apache.org,35293,1679982817593, archiveDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/oldWALs, maxLogs=10 2023-03-28 05:53:39,825 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44025,DS-8b266ab6-672e-4bb8-b73d-e2191b457145,DISK] 2023-03-28 05:53:39,837 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-28 05:53:39,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/WALs/jenkins-hbase4.apache.org,35293,1679982817593/jenkins-hbase4.apache.org%2C35293%2C1679982817593.1679982819770 2023-03-28 05:53:39,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44025,DS-8b266ab6-672e-4bb8-b73d-e2191b457145,DISK]] 2023-03-28 05:53:39,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:53:39,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:39,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-28 05:53:39,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-28 05:53:39,996 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-28 05:53:40,003 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-28 05:53:40,028 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-28 05:53:40,041 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:40,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-28 05:53:40,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-28 05:53:40,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-28 05:53:40,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:53:40,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74444321, jitterRate=0.10930682718753815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:53:40,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-28 05:53:40,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-28 05:53:40,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-28 05:53:40,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-28 05:53:40,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-28 05:53:40,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-28 05:53:40,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 32 msec 2023-03-28 05:53:40,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-28 05:53:40,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-28 05:53:40,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-28 05:53:40,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-28 05:53:40,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-28 05:53:40,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-28 05:53:40,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-28 05:53:40,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-28 05:53:40,204 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:40,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-28 05:53:40,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-28 05:53:40,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-28 05:53:40,222 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-28 05:53:40,222 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-28 05:53:40,222 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:40,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35293,1679982817593, sessionid=0x10129af578b0000, setting cluster-up flag (Was=false) 2023-03-28 05:53:40,237 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:40,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-28 05:53:40,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:40,253 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:40,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-28 05:53:40,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:40,262 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp 2023-03-28 05:53:40,344 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(952): ClusterId : 8af3f01d-d5e1-4983-b2e8-adc1b4385b43 2023-03-28 05:53:40,350 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-28 05:53:40,357 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-28 05:53:40,357 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-28 05:53:40,360 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-28 05:53:40,361 DEBUG [RS:0;jenkins-hbase4:39167] zookeeper.ReadOnlyZKClient(139): Connect 0x4eb5eb04 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:53:40,368 DEBUG [RS:0;jenkins-hbase4:39167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40721ca2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:53:40,368 DEBUG [RS:0;jenkins-hbase4:39167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@444d8074, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-28 05:53:40,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-28 05:53:40,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-28 05:53:40,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-28 05:53:40,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-28 05:53:40,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-03-28 05:53:40,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-03-28 05:53:40,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-28 05:53:40,386 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1679982850387 2023-03-28 05:53:40,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-28 05:53:40,394 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-28 05:53:40,395 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-28 05:53:40,396 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39167 2023-03-28 05:53:40,400 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-28 05:53:40,401 INFO [RS:0;jenkins-hbase4:39167] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-28 05:53:40,401 INFO [RS:0;jenkins-hbase4:39167] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-28 05:53:40,401 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1023): About to register with Master. 2023-03-28 05:53:40,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-28 05:53:40,405 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35293,1679982817593 with isa=jenkins-hbase4.apache.org/172.31.14.131:39167, startcode=1679982818904 2023-03-28 05:53:40,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-28 05:53:40,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-28 05:53:40,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-28 05:53:40,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-28 05:53:40,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-28 05:53:40,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-28 05:53:40,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-28 05:53:40,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-28 05:53:40,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-28 05:53:40,428 DEBUG [RS:0;jenkins-hbase4:39167] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-28 05:53:40,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1679982820427,5,FailOnTimeoutGroup] 2023-03-28 05:53:40,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1679982820428,5,FailOnTimeoutGroup] 2023-03-28 05:53:40,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-28 05:53:40,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,482 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55701, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-28 05:53:40,492 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:40,507 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de 2023-03-28 05:53:40,507 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44787 2023-03-28 05:53:40,507 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-28 05:53:40,512 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-28 05:53:40,512 DEBUG [RS:0;jenkins-hbase4:39167] zookeeper.ZKUtil(162): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:40,512 WARN [RS:0;jenkins-hbase4:39167] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-28 05:53:40,513 INFO [RS:0;jenkins-hbase4:39167] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-28 05:53:40,513 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/WALs/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:40,514 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39167,1679982818904] 2023-03-28 05:53:40,521 DEBUG [RS:0;jenkins-hbase4:39167] zookeeper.ZKUtil(162): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:40,531 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-28 05:53:40,539 INFO [RS:0;jenkins-hbase4:39167] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-28 05:53:40,557 INFO [RS:0;jenkins-hbase4:39167] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-28 05:53:40,560 INFO [RS:0;jenkins-hbase4:39167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:53:40,561 INFO [RS:0;jenkins-hbase4:39167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,562 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-28 05:53:40,568 INFO [RS:0;jenkins-hbase4:39167] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,569 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,569 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,569 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,569 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,569 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,569 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-03-28 05:53:40,569 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,570 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,570 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,570 DEBUG [RS:0;jenkins-hbase4:39167] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-03-28 05:53:40,571 INFO [RS:0;jenkins-hbase4:39167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,571 INFO [RS:0;jenkins-hbase4:39167] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,571 INFO [RS:0;jenkins-hbase4:39167] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,585 INFO [RS:0;jenkins-hbase4:39167] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-28 05:53:40,588 INFO [RS:0;jenkins-hbase4:39167] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39167,1679982818904-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:40,604 INFO [RS:0;jenkins-hbase4:39167] regionserver.Replication(203): jenkins-hbase4.apache.org,39167,1679982818904 started 2023-03-28 05:53:40,604 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39167,1679982818904, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39167, sessionid=0x10129af578b0001 2023-03-28 05:53:40,605 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-28 05:53:40,605 DEBUG [RS:0;jenkins-hbase4:39167] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:40,605 DEBUG [RS:0;jenkins-hbase4:39167] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39167,1679982818904' 2023-03-28 05:53:40,605 DEBUG [RS:0;jenkins-hbase4:39167] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:40,606 DEBUG [RS:0;jenkins-hbase4:39167] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:40,606 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-28 05:53:40,606 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-28 05:53:40,606 DEBUG [RS:0;jenkins-hbase4:39167] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:40,606 DEBUG [RS:0;jenkins-hbase4:39167] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39167,1679982818904' 2023-03-28 05:53:40,607 DEBUG [RS:0;jenkins-hbase4:39167] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-28 05:53:40,607 DEBUG [RS:0;jenkins-hbase4:39167] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-28 05:53:40,608 DEBUG [RS:0;jenkins-hbase4:39167] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-28 05:53:40,608 INFO [RS:0;jenkins-hbase4:39167] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-28 05:53:40,608 INFO [RS:0;jenkins-hbase4:39167] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-28 05:53:40,718 INFO [RS:0;jenkins-hbase4:39167] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39167%2C1679982818904, suffix=, logDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/WALs/jenkins-hbase4.apache.org,39167,1679982818904, archiveDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/oldWALs, maxLogs=32 2023-03-28 05:53:40,736 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44025,DS-8b266ab6-672e-4bb8-b73d-e2191b457145,DISK] 2023-03-28 05:53:40,740 INFO [RS:0;jenkins-hbase4:39167] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/WALs/jenkins-hbase4.apache.org,39167,1679982818904/jenkins-hbase4.apache.org%2C39167%2C1679982818904.1679982820721 2023-03-28 05:53:40,740 DEBUG [RS:0;jenkins-hbase4:39167] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44025,DS-8b266ab6-672e-4bb8-b73d-e2191b457145,DISK]] 2023-03-28 05:53:40,847 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-28 05:53:40,848 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-28 05:53:40,848 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de 2023-03-28 05:53:40,866 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:40,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-28 05:53:40,872 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/info 2023-03-28 05:53:40,873 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-28 05:53:40,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:40,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-28 05:53:40,877 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/rep_barrier 2023-03-28 05:53:40,878 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-28 05:53:40,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:40,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-28 05:53:40,881 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/table 2023-03-28 05:53:40,881 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-28 05:53:40,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:40,884 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740 2023-03-28 05:53:40,885 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740 2023-03-28 05:53:40,889 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-28 05:53:40,891 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-28 05:53:40,895 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:53:40,896 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61211167, jitterRate=-0.08788253366947174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-28 05:53:40,896 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-28 05:53:40,896 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-28 05:53:40,896 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-28 05:53:40,896 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-28 05:53:40,897 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-28 05:53:40,897 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-28 05:53:40,898 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-28 05:53:40,898 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-28 05:53:40,903 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-28 05:53:40,903 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-28 05:53:40,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-28 05:53:40,924 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-28 05:53:40,927 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-28 05:53:41,079 DEBUG [jenkins-hbase4:35293] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-28 05:53:41,082 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39167,1679982818904, state=OPENING 2023-03-28 05:53:41,090 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-28 05:53:41,092 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:41,093 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-28 05:53:41,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:53:41,279 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:41,281 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-28 05:53:41,284 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-28 05:53:41,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-28 05:53:41,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-28 05:53:41,299 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39167%2C1679982818904.meta, suffix=.meta, logDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/WALs/jenkins-hbase4.apache.org,39167,1679982818904, archiveDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/oldWALs, maxLogs=32 2023-03-28 05:53:41,315 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44025,DS-8b266ab6-672e-4bb8-b73d-e2191b457145,DISK] 2023-03-28 05:53:41,319 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/WALs/jenkins-hbase4.apache.org,39167,1679982818904/jenkins-hbase4.apache.org%2C39167%2C1679982818904.meta.1679982821301.meta 2023-03-28 05:53:41,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44025,DS-8b266ab6-672e-4bb8-b73d-e2191b457145,DISK]] 2023-03-28 05:53:41,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:53:41,321 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-28 05:53:41,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-28 05:53:41,343 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-28 05:53:41,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-28 05:53:41,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:41,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-28 05:53:41,349 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-28 05:53:41,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-28 05:53:41,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/info 2023-03-28 05:53:41,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/info 2023-03-28 05:53:41,354 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-28 05:53:41,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:41,355 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-28 05:53:41,357 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/rep_barrier 2023-03-28 05:53:41,357 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/rep_barrier 2023-03-28 05:53:41,357 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-28 05:53:41,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:41,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-28 05:53:41,359 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/table 2023-03-28 05:53:41,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/table 2023-03-28 05:53:41,360 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-28 05:53:41,361 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:41,363 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740 2023-03-28 05:53:41,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740 2023-03-28 05:53:41,369 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-28 05:53:41,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-28 05:53:41,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72329644, jitterRate=0.07779568433761597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-28 05:53:41,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-28 05:53:41,383 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1679982821270 2023-03-28 05:53:41,399 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-28 05:53:41,400 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-28 05:53:41,400 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39167,1679982818904, state=OPEN 2023-03-28 05:53:41,403 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-28 05:53:41,403 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-28 05:53:41,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-28 05:53:41,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39167,1679982818904 in 307 msec 2023-03-28 05:53:41,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-28 05:53:41,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 497 msec 2023-03-28 05:53:41,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1100 sec 2023-03-28 05:53:41,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1679982821417, completionTime=-1 2023-03-28 05:53:41,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-28 05:53:41,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-03-28 05:53:41,479 DEBUG [hconnection-0x4596ad4a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:53:41,483 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43902, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:53:41,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-03-28 05:53:41,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1679982881502 2023-03-28 05:53:41,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1679982941502 2023-03-28 05:53:41,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 84 msec 2023-03-28 05:53:41,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35293,1679982817593-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:41,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35293,1679982817593-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:41,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35293,1679982817593-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:41,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35293, period=300000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:41,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-28 05:53:41,535 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-28 05:53:41,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-28 05:53:41,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-28 05:53:41,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-28 05:53:41,559 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:53:41,562 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:53:41,583 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/hbase/namespace/0926ca83c78808402038919b291142e9 2023-03-28 05:53:41,585 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/hbase/namespace/0926ca83c78808402038919b291142e9 empty. 2023-03-28 05:53:41,586 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/hbase/namespace/0926ca83c78808402038919b291142e9 2023-03-28 05:53:41,586 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-28 05:53:42,012 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-28 05:53:42,014 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0926ca83c78808402038919b291142e9, NAME => 'hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:53:42,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:42,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0926ca83c78808402038919b291142e9, disabling compactions & flushes 2023-03-28 05:53:42,438 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:53:42,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:53:42,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. after waiting 0 ms 2023-03-28 05:53:42,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:53:42,438 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:53:42,438 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0926ca83c78808402038919b291142e9: 2023-03-28 05:53:42,443 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:53:42,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679982822446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982822446"}]},"ts":"1679982822446"} 2023-03-28 05:53:42,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:53:42,487 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:53:42,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982822487"}]},"ts":"1679982822487"} 2023-03-28 05:53:42,495 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-28 05:53:42,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0926ca83c78808402038919b291142e9, ASSIGN}] 2023-03-28 05:53:42,698 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0926ca83c78808402038919b291142e9, ASSIGN 2023-03-28 05:53:42,699 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0926ca83c78808402038919b291142e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:53:42,850 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0926ca83c78808402038919b291142e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:42,851 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679982822850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982822850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982822850"}]},"ts":"1679982822850"} 2023-03-28 05:53:42,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0926ca83c78808402038919b291142e9, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:53:43,014 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:53:43,014 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0926ca83c78808402038919b291142e9, NAME => 'hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:53:43,015 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0926ca83c78808402038919b291142e9 2023-03-28 05:53:43,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:43,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0926ca83c78808402038919b291142e9 2023-03-28 05:53:43,016 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0926ca83c78808402038919b291142e9 2023-03-28 05:53:43,018 INFO [StoreOpener-0926ca83c78808402038919b291142e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0926ca83c78808402038919b291142e9 2023-03-28 05:53:43,020 DEBUG [StoreOpener-0926ca83c78808402038919b291142e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/info 2023-03-28 05:53:43,020 DEBUG [StoreOpener-0926ca83c78808402038919b291142e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/info 2023-03-28 05:53:43,020 INFO [StoreOpener-0926ca83c78808402038919b291142e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0926ca83c78808402038919b291142e9 columnFamilyName info 2023-03-28 05:53:43,021 INFO [StoreOpener-0926ca83c78808402038919b291142e9-1] regionserver.HStore(310): Store=0926ca83c78808402038919b291142e9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:43,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9 2023-03-28 05:53:43,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9 2023-03-28 05:53:43,028 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0926ca83c78808402038919b291142e9 2023-03-28 05:53:43,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:53:43,031 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0926ca83c78808402038919b291142e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74126475, jitterRate=0.10457055270671844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:53:43,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0926ca83c78808402038919b291142e9: 2023-03-28 05:53:43,033 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9., pid=6, masterSystemTime=1679982823008 2023-03-28 05:53:43,037 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:53:43,037 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:53:43,039 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0926ca83c78808402038919b291142e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:43,039 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679982823038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982823038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982823038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982823038"}]},"ts":"1679982823038"} 2023-03-28 05:53:43,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-28 05:53:43,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0926ca83c78808402038919b291142e9, server=jenkins-hbase4.apache.org,39167,1679982818904 in 189 msec 2023-03-28 05:53:43,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-28 05:53:43,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0926ca83c78808402038919b291142e9, ASSIGN in 352 msec 2023-03-28 05:53:43,051 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:53:43,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982823052"}]},"ts":"1679982823052"} 2023-03-28 05:53:43,055 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-28 05:53:43,058 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:53:43,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-28 05:53:43,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.5120 sec 2023-03-28 05:53:43,062 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-28 05:53:43,062 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:53:43,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-28 05:53:43,112 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-28 05:53:43,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-03-28 05:53:43,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-28 05:53:43,140 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-28 05:53:43,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-03-28 05:53:43,155 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-28 05:53:43,158 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-28 05:53:43,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.178sec 2023-03-28 05:53:43,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-28 05:53:43,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-28 05:53:43,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-28 05:53:43,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35293,1679982817593-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-28 05:53:43,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35293,1679982817593-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-28 05:53:43,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-28 05:53:43,251 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(139): Connect 0x449b853a to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:53:43,256 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dbd1c1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:53:43,269 DEBUG [hconnection-0x5831e476-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:53:43,279 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43906, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:53:43,289 INFO [Listener at localhost/33463] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:53:43,290 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(139): Connect 0x143ae868 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:53:43,295 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c173c99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:53:43,295 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:53:43,316 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=397, ProcessCount=172, AvailableMemoryMB=5150 2023-03-28 05:53:43,326 DEBUG [Listener at localhost/33463] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:53:43,330 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:53:43,342 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-28 05:53:43,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:43,345 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:53:43,347 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:53:43,350 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-28 05:53:43,352 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:43,354 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb empty. 2023-03-28 05:53:43,355 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:43,355 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-28 05:53:43,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-28 05:53:43,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-28 05:53:43,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-28 05:53:43,785 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-28 05:53:43,791 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1538c791bf008a0b1c8f2f3b8bee41bb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:53:43,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:43,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 1538c791bf008a0b1c8f2f3b8bee41bb, disabling compactions & flushes 2023-03-28 05:53:43,804 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:43,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:43,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. after waiting 0 ms 2023-03-28 05:53:43,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:43,804 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:43,804 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:43,809 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:53:43,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679982823811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982823811"}]},"ts":"1679982823811"} 2023-03-28 05:53:43,816 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:53:43,819 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:53:43,819 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982823819"}]},"ts":"1679982823819"} 2023-03-28 05:53:43,822 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-28 05:53:43,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, ASSIGN}] 2023-03-28 05:53:43,834 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, ASSIGN 2023-03-28 05:53:43,841 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:53:43,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-28 05:53:43,993 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1538c791bf008a0b1c8f2f3b8bee41bb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:43,994 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679982823993"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982823993"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982823993"}]},"ts":"1679982823993"} 2023-03-28 05:53:43,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1538c791bf008a0b1c8f2f3b8bee41bb, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:53:44,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:44,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1538c791bf008a0b1c8f2f3b8bee41bb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:53:44,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:44,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:44,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:44,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:44,166 INFO [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:44,168 DEBUG [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:44,169 DEBUG [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:44,172 INFO [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1538c791bf008a0b1c8f2f3b8bee41bb columnFamilyName family1 2023-03-28 05:53:44,182 INFO [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] regionserver.HStore(310): Store=1538c791bf008a0b1c8f2f3b8bee41bb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:44,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:44,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:44,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:44,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:53:44,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1538c791bf008a0b1c8f2f3b8bee41bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62890861, jitterRate=-0.062853142619133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:53:44,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:44,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb., pid=11, masterSystemTime=1679982824153 2023-03-28 05:53:44,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:44,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:44,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1538c791bf008a0b1c8f2f3b8bee41bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:44,216 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679982824215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982824215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982824215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982824215"}]},"ts":"1679982824215"} 2023-03-28 05:53:44,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-28 05:53:44,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1538c791bf008a0b1c8f2f3b8bee41bb, server=jenkins-hbase4.apache.org,39167,1679982818904 in 221 msec 2023-03-28 05:53:44,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-28 05:53:44,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, ASSIGN in 398 msec 2023-03-28 05:53:44,233 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:53:44,234 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982824233"}]},"ts":"1679982824233"} 2023-03-28 05:53:44,237 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-28 05:53:44,247 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:53:44,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 905 msec 2023-03-28 05:53:44,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-28 05:53:44,476 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-28 05:53:44,507 DEBUG [hconnection-0x1425f81a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:53:44,515 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:53:44,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:44,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,790 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:44,790 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:44,792 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:44,792 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:44,793 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,794 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,795 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:44,795 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:44,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:44,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:44,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,797 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:44,797 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:44,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:44,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:44,803 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:44,803 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:44,804 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:44,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:44,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:44,830 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:44,832 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:44,833 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-28 05:53:45,091 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130760d6ae85d1f419ba6008dd03c6afa4b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130760d6ae85d1f419ba6008dd03c6afa4b 2023-03-28 05:53:45,113 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/aa55498407934cbfbf90eb45bf5c9059 2023-03-28 05:53:45,128 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/aa55498407934cbfbf90eb45bf5c9059 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/aa55498407934cbfbf90eb45bf5c9059 2023-03-28 05:53:45,141 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/aa55498407934cbfbf90eb45bf5c9059, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-28 05:53:45,145 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 312ms, sequenceid=5, compaction requested=false 2023-03-28 05:53:45,147 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:45,151 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:45,151 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:45,151 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:45,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:45,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:45,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:45,155 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,155 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,155 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,155 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:45,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75c9d35b[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:45,158 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:45,158 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,168 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:45,168 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,168 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:45,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:45,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:45,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,172 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:45,172 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:45,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:45,176 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:45,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:45,176 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:45,176 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:45,176 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,176 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:45,179 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,179 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:45,179 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,181 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,184 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,195 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,195 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,195 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,195 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,195 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,195 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:45,195 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:45,195 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:45,196 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,198 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:45,198 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:45,199 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:45,199 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:45,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:45,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:45,299 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:45,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:45,318 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:45,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:45,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,338 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:45,338 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:45,338 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:45,338 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:45,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,343 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:45,343 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:45,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:45,343 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,343 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,345 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,347 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:45,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:45,348 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:45,349 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:45,349 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-28 05:53:45,385 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f92291e988eb4e95b72ed8032f87de92 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f92291e988eb4e95b72ed8032f87de92 2023-03-28 05:53:45,404 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/5135995ba2d342998a20d6ba27664cc7 2023-03-28 05:53:45,419 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/5135995ba2d342998a20d6ba27664cc7 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/5135995ba2d342998a20d6ba27664cc7 2023-03-28 05:53:45,434 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/5135995ba2d342998a20d6ba27664cc7, entries=1, sequenceid=9, filesize=5.0 K 2023-03-28 05:53:45,444 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 95ms, sequenceid=9, compaction requested=false 2023-03-28 05:53:45,444 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:45,444 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:45,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:45,445 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:45,445 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,445 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:45,445 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:45,449 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:45,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:45,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7432da88[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:45,452 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:45,453 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,455 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:45,455 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:45,455 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:45,455 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,455 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:45,457 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:45,457 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:45,457 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,458 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:45,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:45,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:45,464 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:45,464 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:45,464 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:45,464 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,464 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:45,472 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,472 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,472 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:45,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:45,474 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,478 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,486 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:45,487 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,487 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:45,487 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,487 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:45,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:45,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:45,490 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:45,487 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,490 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,490 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,490 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,490 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-28 05:53:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:45,490 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:45,491 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:45,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:45,591 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:45,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:45,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:45,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:45,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,614 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:45,614 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:45,615 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:45,615 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:45,616 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,616 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,617 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,617 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:45,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:45,618 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,618 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,621 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,621 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:45,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:45,630 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:45,631 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:45,631 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:45,631 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:45,631 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:45,632 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:45,689 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017630d8af0ef949af83fbb2cdddc66dc0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512017630d8af0ef949af83fbb2cdddc66dc0 2023-03-28 05:53:45,713 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/4c634d4bba904619ab2cfa10ae479392 2023-03-28 05:53:45,732 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/4c634d4bba904619ab2cfa10ae479392 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4c634d4bba904619ab2cfa10ae479392 2023-03-28 05:53:45,744 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4c634d4bba904619ab2cfa10ae479392, entries=1, sequenceid=13, filesize=5.0 K 2023-03-28 05:53:45,746 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 114ms, sequenceid=13, compaction requested=true 2023-03-28 05:53:45,747 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:45,747 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:45,751 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,751 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,751 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,751 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:45,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d8e92b2[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:45,755 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:45,755 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,757 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,758 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:45,758 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:45,758 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:45,758 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,758 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:45,761 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:45,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:45,765 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:45,766 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:45,766 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:45,766 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,766 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:45,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:45,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:45,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:45,770 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:45,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,777 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:45,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,784 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:45,784 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:45,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:45,784 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,784 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:45,784 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,785 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:45,785 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:45,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:45,785 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,785 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,785 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,785 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-28 05:53:45,786 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:45,786 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:45,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:45,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:45,886 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:45,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:45,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:45,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:45,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,908 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:45,908 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:45,909 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:45,909 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:45,909 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,909 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,911 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,911 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:45,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:45,912 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:45,912 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,913 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,922 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:45,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:45,923 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:45,923 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:45,923 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:45,924 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:45,924 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:45,924 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:45,924 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:45,924 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:46,381 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d5bc728f04bf476baceb7bae5cd5cfdd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d5bc728f04bf476baceb7bae5cd5cfdd 2023-03-28 05:53:46,421 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/cce2ffacb9f84300bcd4f57f44d6ed9f 2023-03-28 05:53:46,432 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/cce2ffacb9f84300bcd4f57f44d6ed9f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/cce2ffacb9f84300bcd4f57f44d6ed9f 2023-03-28 05:53:46,442 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/cce2ffacb9f84300bcd4f57f44d6ed9f, entries=1, sequenceid=17, filesize=5.0 K 2023-03-28 05:53:46,443 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 519ms, sequenceid=17, compaction requested=true 2023-03-28 05:53:46,443 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:46,443 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:46,443 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:46,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:46,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:46,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:46,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:46,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f613a2d[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:46,459 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:46,459 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,461 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:46,461 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,462 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:46,466 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:46,466 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:46,466 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:46,466 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:46,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:46,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:46,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:46,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:46,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:46,474 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:46,475 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:46,475 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:46,475 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,475 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:46,477 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,477 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:46,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,477 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:46,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:46,479 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:46,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,482 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:46,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,492 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,492 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,492 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:46,492 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:46,492 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:46,492 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:46,492 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:46,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:46,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-28 05:53:46,492 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:46,492 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,493 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:46,493 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,494 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,494 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,494 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:46,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:46,594 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:46,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:46,612 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:46,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:46,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,618 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:46,618 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:46,620 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:46,620 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:46,621 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,621 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,622 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,622 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:46,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:46,623 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:46,623 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:46,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,624 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,624 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:46,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:46,624 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:46,624 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:46,625 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:46,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:46,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:46,625 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:46,912 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:53:47,011 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-28 05:53:47,012 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-28 05:53:47,104 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f0b5a67ee1bd419fa7cc972051ef9ccd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0b5a67ee1bd419fa7cc972051ef9ccd 2023-03-28 05:53:47,128 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/d15fe0cf94164b5488fc7581cb17161f 2023-03-28 05:53:47,139 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/d15fe0cf94164b5488fc7581cb17161f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/d15fe0cf94164b5488fc7581cb17161f 2023-03-28 05:53:47,161 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/d15fe0cf94164b5488fc7581cb17161f, entries=1, sequenceid=21, filesize=5.0 K 2023-03-28 05:53:47,162 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 537ms, sequenceid=21, compaction requested=true 2023-03-28 05:53:47,162 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:47,162 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:47,169 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:47,171 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:47,172 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:47,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:47,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54096f91[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:47,174 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:47,174 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,177 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,177 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:47,177 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:47,177 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:47,177 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,177 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:47,182 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,182 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:47,182 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:47,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:47,182 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:47,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:47,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:47,188 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:47,188 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:47,188 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:47,188 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,188 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:47,190 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,190 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,190 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:47,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:47,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:47,191 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,194 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,198 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,198 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,198 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,198 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,199 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,199 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:47,199 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:47,199 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:47,199 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:47,199 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:47,199 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:47,199 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:47,204 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:47,204 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:47,304 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:47,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:47,316 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:47,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:47,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,322 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:47,322 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:47,323 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:47,323 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:47,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,326 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:47,326 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:47,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:47,326 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,326 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:47,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,327 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,327 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:47,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:47,328 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:47,329 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:47,329 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:47,393 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315e32484ebb7c4ae29117c6cb3d9ad8aa to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315e32484ebb7c4ae29117c6cb3d9ad8aa 2023-03-28 05:53:47,414 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/00b38c2ef69c497991c5f901e8e8d749 2023-03-28 05:53:47,426 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/00b38c2ef69c497991c5f901e8e8d749 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/00b38c2ef69c497991c5f901e8e8d749 2023-03-28 05:53:47,441 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/00b38c2ef69c497991c5f901e8e8d749, entries=1, sequenceid=25, filesize=5.0 K 2023-03-28 05:53:47,442 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 113ms, sequenceid=25, compaction requested=true 2023-03-28 05:53:47,442 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:47,442 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:47,442 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:47,443 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:47,443 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,443 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:47,443 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,446 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:47,447 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,447 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:47,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:47,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@368d1902[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:47,449 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:47,449 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,452 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,452 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:47,452 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:47,452 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:47,452 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,452 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:47,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,454 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:47,454 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:47,454 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:47,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:47,468 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:47,468 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:47,468 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:47,468 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,468 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:47,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:47,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:47,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:47,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:47,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:47,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:47,477 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,480 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:47,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,484 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:47,484 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:47,484 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,484 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:47,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:47,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:47,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:47,484 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:47,486 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,486 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,486 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,486 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,486 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:47,486 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:47,486 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,587 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:47,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:47,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:47,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:47,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,607 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:47,607 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:47,608 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:47,608 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:47,609 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,609 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,611 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,611 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:47,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:47,611 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:47,611 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,616 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:47,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:47,617 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:47,617 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:47,617 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:47,617 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:47,617 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:47,617 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:47,775 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-28 05:53:47,776 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-28 05:53:48,086 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013999722d407d4e3588c9903145059b27 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601013999722d407d4e3588c9903145059b27 2023-03-28 05:53:48,586 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/87eacf437eea4646b12b2a72ca0af45d 2023-03-28 05:53:48,598 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/87eacf437eea4646b12b2a72ca0af45d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/87eacf437eea4646b12b2a72ca0af45d 2023-03-28 05:53:48,609 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/87eacf437eea4646b12b2a72ca0af45d, entries=1, sequenceid=29, filesize=5.0 K 2023-03-28 05:53:48,610 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 993ms, sequenceid=29, compaction requested=true 2023-03-28 05:53:48,611 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:48,611 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:48,611 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:48,612 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:48,612 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,612 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:48,612 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:48,614 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,615 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:48,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:48,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,616 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:48,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:48,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f3f0663[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:48,621 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:48,621 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,623 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,623 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:48,623 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:48,623 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:48,623 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,623 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:48,626 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:48,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:48,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:48,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:48,631 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:48,631 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:48,631 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:48,631 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,631 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:48,634 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,634 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:48,634 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:48,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:48,635 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:48,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,637 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:48,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,644 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,644 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,644 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,644 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:48,644 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:48,644 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:48,644 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,645 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,645 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,645 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:48,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:48,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:48,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:48,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-28 05:53:48,646 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:48,646 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:48,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:48,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:48,746 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:48,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:48,760 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:48,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:48,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,777 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:48,777 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:48,788 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:48,788 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:48,797 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,798 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,801 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:48,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:48,801 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,802 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:48,802 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:48,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,803 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,812 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:48,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:48,824 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:48,825 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:48,825 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:48,825 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:48,825 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:48,826 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:49,279 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030ff592c3d631459fb8db74b05b846e29 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030ff592c3d631459fb8db74b05b846e29 2023-03-28 05:53:49,693 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/0a4933b53b9b41119d36b7a23a13cfe1 2023-03-28 05:53:49,709 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/0a4933b53b9b41119d36b7a23a13cfe1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/0a4933b53b9b41119d36b7a23a13cfe1 2023-03-28 05:53:49,728 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/0a4933b53b9b41119d36b7a23a13cfe1, entries=1, sequenceid=33, filesize=5.0 K 2023-03-28 05:53:49,740 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 914ms, sequenceid=33, compaction requested=true 2023-03-28 05:53:49,740 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:49,740 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:49,740 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:49,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:49,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:49,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:49,743 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,743 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:49,744 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,744 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:49,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:49,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79e9f7fb[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:49,747 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:49,747 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,750 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,750 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:49,750 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:49,751 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:49,751 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,751 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:49,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:49,753 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:49,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:49,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:49,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:49,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:49,764 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:49,764 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:49,764 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:49,764 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,764 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:49,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:49,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:49,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:49,771 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:49,775 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,780 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:49,780 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:49,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:49,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:49,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:49,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:49,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,782 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:49,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:49,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:49,783 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:49,783 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:49,884 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:49,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:49,896 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:49,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:49,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,903 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:49,903 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:49,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:49,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:49,907 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,907 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,909 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,909 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:49,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,910 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:49,910 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:49,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:49,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,911 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,911 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:49,911 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:49,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:49,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:49,914 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:49,914 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:49,914 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:49,914 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:49,915 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:50,079 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090786e49bb384bf49afbab46496f98c98bc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090786e49bb384bf49afbab46496f98c98bc 2023-03-28 05:53:50,494 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/dacc56dbb932412181d3f11c7b68086d 2023-03-28 05:53:50,503 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/dacc56dbb932412181d3f11c7b68086d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/dacc56dbb932412181d3f11c7b68086d 2023-03-28 05:53:50,511 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/dacc56dbb932412181d3f11c7b68086d, entries=1, sequenceid=37, filesize=5.0 K 2023-03-28 05:53:50,513 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 598ms, sequenceid=37, compaction requested=true 2023-03-28 05:53:50,513 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:50,513 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:50,513 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:50,514 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:50,514 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,514 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:50,514 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:50,516 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:50,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:50,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:50,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:50,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66837ab0[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:50,518 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:50,518 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,520 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:50,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:50,520 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,520 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:50,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:50,522 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:50,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:50,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:50,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:50,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:50,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:50,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:50,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:50,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:50,525 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:50,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:50,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:50,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,526 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:50,527 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,527 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:50,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,528 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:50,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:50,528 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:50,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,530 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:50,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-28 05:53:50,533 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:50,533 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:50,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:50,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:50,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:50,533 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:50,534 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:50,535 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:50,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:50,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:50,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:50,537 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,537 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,537 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,537 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,537 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,537 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,537 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,635 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:50,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:50,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:50,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:50,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,648 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:50,648 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:50,648 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-28 05:53:50,648 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-28 05:53:50,649 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,649 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,652 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:50,652 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:50,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:50,653 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,653 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,654 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,654 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-28 05:53:50,654 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,654 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-28 05:53:50,655 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-28 05:53:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:50,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:50,656 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:50,656 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. started... 2023-03-28 05:53:50,657 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1538c791bf008a0b1c8f2f3b8bee41bb 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:50,698 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b22f462099e14cdc88138f77592e5795 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b22f462099e14cdc88138f77592e5795 2023-03-28 05:53:50,708 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/52b68ae9961d4ff1a1673a59d4516562 2023-03-28 05:53:50,715 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/52b68ae9961d4ff1a1673a59d4516562 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/52b68ae9961d4ff1a1673a59d4516562 2023-03-28 05:53:50,723 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/52b68ae9961d4ff1a1673a59d4516562, entries=1, sequenceid=41, filesize=5.0 K 2023-03-28 05:53:50,725 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1538c791bf008a0b1c8f2f3b8bee41bb in 68ms, sequenceid=41, compaction requested=true 2023-03-28 05:53:50,725 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:50,725 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:50,725 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:50,726 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:50,726 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,726 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-28 05:53:50,726 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-28 05:53:50,728 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,728 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:50,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:50,728 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,728 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:50,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:50,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:50,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:50,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-28 05:53:50,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38982a6b[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:50,730 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-28 05:53:50,730 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,732 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,732 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-28 05:53:50,732 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-28 05:53:50,732 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:50,732 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,732 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:50,738 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-28 05:53:50,738 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:50,738 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-28 05:53:50,739 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:50,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-28 05:53:50,746 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-28 05:53:50,746 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:50,746 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:50,746 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,746 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:50,749 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,749 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:50,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,749 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:50,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:50,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:50,750 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:50,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,752 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:50,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:50,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:50,759 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,759 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:50,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-28 05:53:50,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:50,759 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:50,760 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:50,860 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:50,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:50,868 DEBUG [Listener at localhost/33463] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-28 05:53:50,871 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-28 05:53:50,872 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:50,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-28 05:53:50,890 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-28 05:53:50,892 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983430892 2023-03-28 05:53:50,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:53:50,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:53:50,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-28 05:53:50,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:50,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x6bd7fb37 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:53:50,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ba73e6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:53:50,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,047 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103583880c8be094a1e9af38ee9a52d8d5b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103583880c8be094a1e9af38ee9a52d8d5b 2023-03-28 05:53:51,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:51,072 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:53:51,074 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:53:51,092 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:53:51,094 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52412, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:53:51,139 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/394504321a3145e5ba251756db560c20 first=Optional[r3] last=Optional[r6] 2023-03-28 05:53:51,154 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/394504321a3145e5ba251756db560c20}] 2023-03-28 05:53:51,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/394504321a3145e5ba251756db560c20 for inclusion in 1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:51,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-28 05:53:51,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:53:51,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:51,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/394504321a3145e5ba251756db560c20 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oteartvjsucjgifrailga72fef3ubmc7liuuuv1l0jvut7ahadpcjd9rnu1bui00/family1/394504321a3145e5ba251756db560c20 2023-03-28 05:53:51,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oteartvjsucjgifrailga72fef3ubmc7liuuuv1l0jvut7ahadpcjd9rnu1bui00/family1/394504321a3145e5ba251756db560c20 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_ 2023-03-28 05:53:51,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oteartvjsucjgifrailga72fef3ubmc7liuuuv1l0jvut7ahadpcjd9rnu1bui00/family1/394504321a3145e5ba251756db560c20 into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_ - updating store file list. 2023-03-28 05:53:51,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_ into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:51,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oteartvjsucjgifrailga72fef3ubmc7liuuuv1l0jvut7ahadpcjd9rnu1bui00/family1/394504321a3145e5ba251756db560c20 into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_) 2023-03-28 05:53:51,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oteartvjsucjgifrailga72fef3ubmc7liuuuv1l0jvut7ahadpcjd9rnu1bui00/family1/394504321a3145e5ba251756db560c20 2023-03-28 05:53:51,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-28 05:53:51,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-28 05:53:51,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(1912): 1538c791bf008a0b1c8f2f3b8bee41bb/family1 is initiating minor compaction 2023-03-28 05:53:51,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1727acb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:53:51,211 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1538c791bf008a0b1c8f2f3b8bee41bb/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:51,212 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/5135995ba2d342998a20d6ba27664cc7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4c634d4bba904619ab2cfa10ae479392, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/cce2ffacb9f84300bcd4f57f44d6ed9f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/d15fe0cf94164b5488fc7581cb17161f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/00b38c2ef69c497991c5f901e8e8d749, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/87eacf437eea4646b12b2a72ca0af45d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/0a4933b53b9b41119d36b7a23a13cfe1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/dacc56dbb932412181d3f11c7b68086d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/52b68ae9961d4ff1a1673a59d4516562, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp, totalSize=50.2 K 2023-03-28 05:53:51,213 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 5135995ba2d342998a20d6ba27664cc7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:53:51,213 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 4c634d4bba904619ab2cfa10ae479392, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:53:51,213 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting cce2ffacb9f84300bcd4f57f44d6ed9f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-28 05:53:51,213 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting d15fe0cf94164b5488fc7581cb17161f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-28 05:53:51,214 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 00b38c2ef69c497991c5f901e8e8d749, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-28 05:53:51,214 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 87eacf437eea4646b12b2a72ca0af45d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-28 05:53:51,214 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 0a4933b53b9b41119d36b7a23a13cfe1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-28 05:53:51,214 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting dacc56dbb932412181d3f11c7b68086d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-28 05:53:51,214 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 52b68ae9961d4ff1a1673a59d4516562, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-28 05:53:51,214 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 14cb6c83b29f4ad58a7282555c64b336_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-28 05:53:51,230 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:51,232 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:53:51,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0b5a67ee1bd419fa7cc972051ef9ccd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0b5a67ee1bd419fa7cc972051ef9ccd 2023-03-28 05:53:51,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315e32484ebb7c4ae29117c6cb3d9ad8aa to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315e32484ebb7c4ae29117c6cb3d9ad8aa 2023-03-28 05:53:51,248 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601013999722d407d4e3588c9903145059b27 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601013999722d407d4e3588c9903145059b27 2023-03-28 05:53:51,250 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030ff592c3d631459fb8db74b05b846e29 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030ff592c3d631459fb8db74b05b846e29 2023-03-28 05:53:51,250 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-28 05:53:51,250 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,325 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1538c791bf008a0b1c8f2f3b8bee41bb#family1#compaction#10 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:53:51,415 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/7639f0c25d9b49d8951a2cfbf62daccd as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/7639f0c25d9b49d8951a2cfbf62daccd 2023-03-28 05:53:51,432 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120535b11d38d8024e5492779d971850b5c7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120535b11d38d8024e5492779d971850b5c7 2023-03-28 05:53:51,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:51,441 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1538c791bf008a0b1c8f2f3b8bee41bb/family1 of 1538c791bf008a0b1c8f2f3b8bee41bb into 7639f0c25d9b49d8951a2cfbf62daccd(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:53:51,442 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:51,444 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1679982831209; duration=0sec 2023-03-28 05:53:51,446 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:53:51,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/5135995ba2d342998a20d6ba27664cc7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4c634d4bba904619ab2cfa10ae479392, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/cce2ffacb9f84300bcd4f57f44d6ed9f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/d15fe0cf94164b5488fc7581cb17161f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/00b38c2ef69c497991c5f901e8e8d749, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/87eacf437eea4646b12b2a72ca0af45d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/0a4933b53b9b41119d36b7a23a13cfe1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/dacc56dbb932412181d3f11c7b68086d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/52b68ae9961d4ff1a1673a59d4516562, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_] to archive 2023-03-28 05:53:51,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:53:51,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/5135995ba2d342998a20d6ba27664cc7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/5135995ba2d342998a20d6ba27664cc7 2023-03-28 05:53:51,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4c634d4bba904619ab2cfa10ae479392 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4c634d4bba904619ab2cfa10ae479392 2023-03-28 05:53:51,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/cce2ffacb9f84300bcd4f57f44d6ed9f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/cce2ffacb9f84300bcd4f57f44d6ed9f 2023-03-28 05:53:51,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/d15fe0cf94164b5488fc7581cb17161f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/d15fe0cf94164b5488fc7581cb17161f 2023-03-28 05:53:51,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/00b38c2ef69c497991c5f901e8e8d749 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/00b38c2ef69c497991c5f901e8e8d749 2023-03-28 05:53:51,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/87eacf437eea4646b12b2a72ca0af45d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/87eacf437eea4646b12b2a72ca0af45d 2023-03-28 05:53:51,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/0a4933b53b9b41119d36b7a23a13cfe1 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/0a4933b53b9b41119d36b7a23a13cfe1 2023-03-28 05:53:51,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/dacc56dbb932412181d3f11c7b68086d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/dacc56dbb932412181d3f11c7b68086d 2023-03-28 05:53:51,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/52b68ae9961d4ff1a1673a59d4516562 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/52b68ae9961d4ff1a1673a59d4516562 2023-03-28 05:53:51,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/14cb6c83b29f4ad58a7282555c64b336_SeqId_44_ 2023-03-28 05:53:51,552 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d17b62c8a9654331bc292ce19260defe first=Optional[r00] last=Optional[r2] 2023-03-28 05:53:51,553 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d17b62c8a9654331bc292ce19260defe}] 2023-03-28 05:53:51,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d17b62c8a9654331bc292ce19260defe for inclusion in 1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:51,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-28 05:53:51,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:53:51,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:51,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d17b62c8a9654331bc292ce19260defe to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pq6pcdk6fself5b79ummho0m420s2fvp8gg93fqi1n4jf0pg6mac6s0l294o059n/family1/d17b62c8a9654331bc292ce19260defe 2023-03-28 05:53:51,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pq6pcdk6fself5b79ummho0m420s2fvp8gg93fqi1n4jf0pg6mac6s0l294o059n/family1/d17b62c8a9654331bc292ce19260defe as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_ 2023-03-28 05:53:51,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pq6pcdk6fself5b79ummho0m420s2fvp8gg93fqi1n4jf0pg6mac6s0l294o059n/family1/d17b62c8a9654331bc292ce19260defe into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_ - updating store file list. 2023-03-28 05:53:51,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_ into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:51,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pq6pcdk6fself5b79ummho0m420s2fvp8gg93fqi1n4jf0pg6mac6s0l294o059n/family1/d17b62c8a9654331bc292ce19260defe into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_) 2023-03-28 05:53:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pq6pcdk6fself5b79ummho0m420s2fvp8gg93fqi1n4jf0pg6mac6s0l294o059n/family1/d17b62c8a9654331bc292ce19260defe 2023-03-28 05:53:51,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-28 05:53:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-28 05:53:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(1912): 1538c791bf008a0b1c8f2f3b8bee41bb/family1 is initiating minor compaction (all files) 2023-03-28 05:53:51,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@57585146; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:53:51,586 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1538c791bf008a0b1c8f2f3b8bee41bb/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:51,587 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/aa55498407934cbfbf90eb45bf5c9059, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/7639f0c25d9b49d8951a2cfbf62daccd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp, totalSize=358.6 K 2023-03-28 05:53:51,588 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting aa55498407934cbfbf90eb45bf5c9059, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843296 2023-03-28 05:53:51,589 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 7639f0c25d9b49d8951a2cfbf62daccd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243296 2023-03-28 05:53:51,589 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 4b1a459481a94abd97603ffa8a57679c_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878843296 2023-03-28 05:53:51,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:51,592 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:53:51,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130760d6ae85d1f419ba6008dd03c6afa4b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130760d6ae85d1f419ba6008dd03c6afa4b 2023-03-28 05:53:51,603 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512017630d8af0ef949af83fbb2cdddc66dc0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512017630d8af0ef949af83fbb2cdddc66dc0 2023-03-28 05:53:51,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d5bc728f04bf476baceb7bae5cd5cfdd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d5bc728f04bf476baceb7bae5cd5cfdd 2023-03-28 05:53:51,605 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-28 05:53:51,605 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-28 05:53:51,605 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:51,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:51,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:53:51,607 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-28 05:53:51,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 729 msec 2023-03-28 05:53:51,692 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1538c791bf008a0b1c8f2f3b8bee41bb#family1#compaction#11 average throughput is 2.54 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:53:51,867 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-28 05:53:51,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:51,899 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-28 05:53:51,901 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-28 05:53:51,901 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-28 05:53:51,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-28 05:53:51,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, REOPEN/MOVE}] 2023-03-28 05:53:51,925 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, REOPEN/MOVE 2023-03-28 05:53:51,927 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1538c791bf008a0b1c8f2f3b8bee41bb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:51,927 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679982831927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982831927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982831927"}]},"ts":"1679982831927"} 2023-03-28 05:53:51,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 1538c791bf008a0b1c8f2f3b8bee41bb, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:53:52,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1538c791bf008a0b1c8f2f3b8bee41bb, disabling compactions & flushes 2023-03-28 05:53:52,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,562 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/.tmp/family1/09b1f527d49d4458abe6ddd8e55bdf78 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/09b1f527d49d4458abe6ddd8e55bdf78 2023-03-28 05:53:52,573 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1538c791bf008a0b1c8f2f3b8bee41bb/family1 of 1538c791bf008a0b1c8f2f3b8bee41bb into 09b1f527d49d4458abe6ddd8e55bdf78(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:53:52,573 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:52,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,573 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1679982831586; duration=0sec 2023-03-28 05:53:52,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. after waiting 0 ms 2023-03-28 05:53:52,574 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:53:52,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,577 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/aa55498407934cbfbf90eb45bf5c9059, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/7639f0c25d9b49d8951a2cfbf62daccd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_] to archive 2023-03-28 05:53:52,578 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:53:52,581 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/aa55498407934cbfbf90eb45bf5c9059 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/aa55498407934cbfbf90eb45bf5c9059 2023-03-28 05:53:52,583 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/7639f0c25d9b49d8951a2cfbf62daccd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/7639f0c25d9b49d8951a2cfbf62daccd 2023-03-28 05:53:52,585 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/4b1a459481a94abd97603ffa8a57679c_SeqId_47_ 2023-03-28 05:53:52,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-28 05:53:52,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:52,598 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1538c791bf008a0b1c8f2f3b8bee41bb to self. 2023-03-28 05:53:52,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1538c791bf008a0b1c8f2f3b8bee41bb, regionState=CLOSED 2023-03-28 05:53:52,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679982832601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982832601"}]},"ts":"1679982832601"} 2023-03-28 05:53:52,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-28 05:53:52,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 1538c791bf008a0b1c8f2f3b8bee41bb, server=jenkins-hbase4.apache.org,39167,1679982818904 in 674 msec 2023-03-28 05:53:52,607 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=true 2023-03-28 05:53:52,758 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1538c791bf008a0b1c8f2f3b8bee41bb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:52,758 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679982832758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982832758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982832758"}]},"ts":"1679982832758"} 2023-03-28 05:53:52,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 1538c791bf008a0b1c8f2f3b8bee41bb, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:53:52,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1538c791bf008a0b1c8f2f3b8bee41bb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:53:52,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:52,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,928 INFO [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,930 DEBUG [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:52,930 DEBUG [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:52,930 INFO [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1538c791bf008a0b1c8f2f3b8bee41bb columnFamilyName family1 2023-03-28 05:53:52,942 DEBUG [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/09b1f527d49d4458abe6ddd8e55bdf78 2023-03-28 05:53:52,943 INFO [StoreOpener-1538c791bf008a0b1c8f2f3b8bee41bb-1] regionserver.HStore(310): Store=1538c791bf008a0b1c8f2f3b8bee41bb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:52,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:53:52,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1538c791bf008a0b1c8f2f3b8bee41bb; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60624368, jitterRate=-0.09662652015686035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:53:52,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:52,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb., pid=17, masterSystemTime=1679982832914 2023-03-28 05:53:52,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:53:52,960 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1538c791bf008a0b1c8f2f3b8bee41bb, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:52,960 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679982832960"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982832960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982832960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982832960"}]},"ts":"1679982832960"} 2023-03-28 05:53:52,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-28 05:53:52,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 1538c791bf008a0b1c8f2f3b8bee41bb, server=jenkins-hbase4.apache.org,39167,1679982818904 in 208 msec 2023-03-28 05:53:52,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-28 05:53:52,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=1538c791bf008a0b1c8f2f3b8bee41bb, REOPEN/MOVE in 1.0480 sec 2023-03-28 05:53:52,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-28 05:53:52,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0720 sec 2023-03-28 05:53:52,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.1160 sec 2023-03-28 05:53:52,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-28 05:53:53,005 INFO [Listener at localhost/33463] compactions.TestMobCompactor(278): alter status finished 2023-03-28 05:53:53,007 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-28 05:53:53,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-28 05:53:53,011 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-28 05:53:53,012 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983433012 2023-03-28 05:53:53,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:53:53,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:53:53,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-28 05:53:53,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:53,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x25f47b87 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:53:53,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b33e6b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:53:53,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,035 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,035 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,512 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fb33b360ce1649dc8ab41f9d2292bba7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128fb33b360ce1649dc8ab41f9d2292bba7 2023-03-28 05:53:53,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:53,529 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:53:53,531 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51062, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:53:53,545 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:53:53,549 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37980, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:53:53,586 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f99b6fddea324aa8aa7d8976a92f13de first=Optional[r05] last=Optional[r8] 2023-03-28 05:53:53,587 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=51 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f99b6fddea324aa8aa7d8976a92f13de}] 2023-03-28 05:53:53,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f99b6fddea324aa8aa7d8976a92f13de for inclusion in 1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:53,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-28 05:53:53,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:53:53,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:53:53,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f99b6fddea324aa8aa7d8976a92f13de to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ndictf773dshloq05mdic35ct7p4i7at3slbl7818osc3ihsoh9tt5s29mvk0c9/family1/f99b6fddea324aa8aa7d8976a92f13de 2023-03-28 05:53:53,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ndictf773dshloq05mdic35ct7p4i7at3slbl7818osc3ihsoh9tt5s29mvk0c9/family1/f99b6fddea324aa8aa7d8976a92f13de as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/c2a7af41bd8e400094de228cd3fb94fd_SeqId_53_ 2023-03-28 05:53:53,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ndictf773dshloq05mdic35ct7p4i7at3slbl7818osc3ihsoh9tt5s29mvk0c9/family1/f99b6fddea324aa8aa7d8976a92f13de into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/c2a7af41bd8e400094de228cd3fb94fd_SeqId_53_ - updating store file list. 2023-03-28 05:53:53,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/c2a7af41bd8e400094de228cd3fb94fd_SeqId_53_ into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 2023-03-28 05:53:53,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ndictf773dshloq05mdic35ct7p4i7at3slbl7818osc3ihsoh9tt5s29mvk0c9/family1/f99b6fddea324aa8aa7d8976a92f13de into 1538c791bf008a0b1c8f2f3b8bee41bb/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/family1/c2a7af41bd8e400094de228cd3fb94fd_SeqId_53_) 2023-03-28 05:53:53,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ndictf773dshloq05mdic35ct7p4i7at3slbl7818osc3ihsoh9tt5s29mvk0c9/family1/f99b6fddea324aa8aa7d8976a92f13de 2023-03-28 05:53:53,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:53,643 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:53:53,646 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b22f462099e14cdc88138f77592e5795 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b22f462099e14cdc88138f77592e5795 2023-03-28 05:53:53,649 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f92291e988eb4e95b72ed8032f87de92 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128f92291e988eb4e95b72ed8032f87de92 2023-03-28 05:53:53,649 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-28 05:53:53,649 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-28 05:53:53,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-28 05:53:53,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-28 05:53:53,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:53:53,651 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-28 05:53:53,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 643 msec 2023-03-28 05:53:53,799 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 212) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x6bd7fb37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1012498932.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52982 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2efff1b8-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52938 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52862 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616d9bfd-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53024 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53052 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53088 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2efff1b8-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2efff1b8-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616d9bfd-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616d9bfd-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52822 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x25f47b87-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1699592305_15 at /127.0.0.1:52980 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616d9bfd-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x6bd7fb37-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53010 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x25f47b87-SendThread(127.0.0.1:58236) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53038 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53036 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53144 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:39167-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52962 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52902 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x6bd7fb37-SendThread(127.0.0.1:58236) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x616d9bfd-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52990 [Waiting for operation #27] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52970 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x25f47b87 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1012498932.run(Unknown Source) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=599 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=465 (was 397) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=4718 (was 5150) 2023-03-28 05:53:53,825 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=465, ProcessCount=172, AvailableMemoryMB=4716 2023-03-28 05:53:53,831 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-28 05:53:53,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:53,836 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:53:53,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-28 05:53:53,837 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:53:53,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-28 05:53:53,848 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:53,849 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6 empty. 2023-03-28 05:53:53,850 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:53,850 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-28 05:53:53,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-28 05:53:54,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-28 05:53:54,289 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-28 05:53:54,291 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 51ab46570fba25557380b69853bf5ba6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:53:54,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-28 05:53:54,701 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:54,701 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 51ab46570fba25557380b69853bf5ba6, disabling compactions & flushes 2023-03-28 05:53:54,701 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:54,702 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:54,702 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. after waiting 0 ms 2023-03-28 05:53:54,702 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:54,702 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:54,702 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:54,705 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:53:54,706 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679982834706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982834706"}]},"ts":"1679982834706"} 2023-03-28 05:53:54,708 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:53:54,709 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:53:54,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982834709"}]},"ts":"1679982834709"} 2023-03-28 05:53:54,711 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-28 05:53:54,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=51ab46570fba25557380b69853bf5ba6, ASSIGN}] 2023-03-28 05:53:54,717 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=51ab46570fba25557380b69853bf5ba6, ASSIGN 2023-03-28 05:53:54,718 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=51ab46570fba25557380b69853bf5ba6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:53:54,869 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=51ab46570fba25557380b69853bf5ba6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:54,869 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679982834869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982834869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982834869"}]},"ts":"1679982834869"} 2023-03-28 05:53:54,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 51ab46570fba25557380b69853bf5ba6, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:53:54,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-28 05:53:55,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:55,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 51ab46570fba25557380b69853bf5ba6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:53:55,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:55,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:53:55,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:55,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:55,032 INFO [StoreOpener-51ab46570fba25557380b69853bf5ba6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:55,034 DEBUG [StoreOpener-51ab46570fba25557380b69853bf5ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:53:55,034 DEBUG [StoreOpener-51ab46570fba25557380b69853bf5ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:53:55,034 INFO [StoreOpener-51ab46570fba25557380b69853bf5ba6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 51ab46570fba25557380b69853bf5ba6 columnFamilyName family1 2023-03-28 05:53:55,037 INFO [StoreOpener-51ab46570fba25557380b69853bf5ba6-1] regionserver.HStore(310): Store=51ab46570fba25557380b69853bf5ba6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:53:55,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:55,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:55,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 51ab46570fba25557380b69853bf5ba6 2023-03-28 05:53:55,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:53:55,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 51ab46570fba25557380b69853bf5ba6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59644417, jitterRate=-0.11122892796993256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:53:55,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:55,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6., pid=21, masterSystemTime=1679982835024 2023-03-28 05:53:55,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:55,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:55,050 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=51ab46570fba25557380b69853bf5ba6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:55,050 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679982835050"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982835050"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982835050"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982835050"}]},"ts":"1679982835050"} 2023-03-28 05:53:55,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-28 05:53:55,055 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 51ab46570fba25557380b69853bf5ba6, server=jenkins-hbase4.apache.org,39167,1679982818904 in 180 msec 2023-03-28 05:53:55,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-28 05:53:55,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=51ab46570fba25557380b69853bf5ba6, ASSIGN in 340 msec 2023-03-28 05:53:55,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:53:55,060 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982835060"}]},"ts":"1679982835060"} 2023-03-28 05:53:55,062 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-28 05:53:55,064 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:53:55,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2340 sec 2023-03-28 05:53:55,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-28 05:53:55,951 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-28 05:53:55,992 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:55,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:55,994 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:55,994 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:55,995 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:55,995 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:55,995 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:55,995 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:55,998 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:55,998 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:55,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:55,998 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:55,998 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:55,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,000 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,000 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:56,000 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:56,001 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:56,001 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:56,001 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:56,001 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:56,001 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:56,002 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-28 05:53:56,091 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308b4f42eb06de41efb0e79b984c6318c5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308b4f42eb06de41efb0e79b984c6318c5 2023-03-28 05:53:56,496 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/d1812e63bdbd404d91c1eaac31989c05 2023-03-28 05:53:56,503 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/d1812e63bdbd404d91c1eaac31989c05 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1812e63bdbd404d91c1eaac31989c05 2023-03-28 05:53:56,510 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1812e63bdbd404d91c1eaac31989c05, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-28 05:53:56,511 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 509ms, sequenceid=5, compaction requested=false 2023-03-28 05:53:56,511 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:56,521 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:56,521 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:56,523 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:56,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:56,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:56,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:56,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:56,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ff32f05[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:56,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:56,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,526 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,527 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:56,527 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:56,527 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:56,527 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,527 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:56,528 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,528 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:56,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:56,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:56,528 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:56,528 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:56,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:56,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:56,532 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:56,532 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:56,532 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:56,532 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,532 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:56,535 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,535 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,535 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:56,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:56,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:56,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:56,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:56,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,540 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,540 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,540 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:56,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:56,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:56,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:56,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:56,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,541 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:56,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:56,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,542 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:56,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:56,542 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:56,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:53:56,642 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:56,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:56,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:56,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:56,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,657 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:56,658 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:56,658 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:56,658 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:56,659 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,659 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,661 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:56,661 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:56,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:56,661 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,661 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:56,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:56,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,663 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,663 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:56,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,664 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:56,664 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:56,664 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:56,664 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:56,665 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:56,665 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:56,665 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:56,665 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-28 05:53:56,683 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284b6dbec19ae34d639db3cd883c262b80 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511284b6dbec19ae34d639db3cd883c262b80 2023-03-28 05:53:56,689 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/3f2f59b9cb714f5f975b820473e8d695 2023-03-28 05:53:56,695 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/3f2f59b9cb714f5f975b820473e8d695 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/3f2f59b9cb714f5f975b820473e8d695 2023-03-28 05:53:56,703 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/3f2f59b9cb714f5f975b820473e8d695, entries=1, sequenceid=9, filesize=5.0 K 2023-03-28 05:53:56,704 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 39ms, sequenceid=9, compaction requested=false 2023-03-28 05:53:56,704 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:56,704 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:56,704 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:56,704 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:56,704 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,704 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:56,704 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:56,707 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,707 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:56,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:56,708 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,708 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:56,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:56,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:56,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:56,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69134d2f[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:56,716 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:56,716 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,719 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,719 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:56,719 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:56,719 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:56,719 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,719 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:56,721 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:56,721 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,722 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:56,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:56,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:56,722 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:56,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:56,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:56,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:56,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:56,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:56,726 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:56,726 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:56,726 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:56,726 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,726 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:56,728 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,728 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,728 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:56,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:56,730 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:56,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:56,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,733 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:56,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:53:56,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:56,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:56,742 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:56,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:56,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:56,743 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:56,743 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:56,843 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:56,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:56,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:56,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:56,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,854 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:56,854 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:56,855 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:56,855 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:56,856 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,856 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,857 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:56,857 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:56,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:56,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,860 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:56,860 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:56,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,861 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,862 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:56,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:56,863 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:56,863 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:56,863 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:56,863 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:56,863 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:56,863 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:56,883 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201867ac35ebb0244359836a62b9061475a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201867ac35ebb0244359836a62b9061475a 2023-03-28 05:53:57,303 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/d6b21e56fb6f436db588f3978cfd70d2 2023-03-28 05:53:57,310 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/d6b21e56fb6f436db588f3978cfd70d2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d6b21e56fb6f436db588f3978cfd70d2 2023-03-28 05:53:57,316 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d6b21e56fb6f436db588f3978cfd70d2, entries=1, sequenceid=13, filesize=4.9 K 2023-03-28 05:53:57,317 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 454ms, sequenceid=13, compaction requested=true 2023-03-28 05:53:57,317 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:57,317 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:57,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:57,320 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:57,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:57,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:57,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:57,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:57,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:57,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:57,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14b8ec47[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:57,322 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:57,322 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:57,324 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:57,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:57,327 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:57,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:57,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:57,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:57,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:57,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:57,330 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:57,330 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:57,330 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:57,330 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,330 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:57,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:57,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:57,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:57,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:57,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:57,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:57,333 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:57,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,335 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:57,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,338 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,339 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:57,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:57,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:57,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:57,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:57,340 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:57,340 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:57,440 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:57,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:57,448 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:57,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:57,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,450 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:57,450 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:57,451 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:57,451 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:57,451 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,451 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,453 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,453 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:57,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:57,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:57,453 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,453 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:57,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:57,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,454 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,454 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:57,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,454 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:57,454 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:57,455 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:57,455 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:57,455 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:57,455 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:57,455 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:57,455 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:57,873 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b95f2e5f46584f6bbc0e761edd62360d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205b95f2e5f46584f6bbc0e761edd62360d 2023-03-28 05:53:57,884 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/d1c17c2c280945aeadcf3b05c393431c 2023-03-28 05:53:57,893 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/d1c17c2c280945aeadcf3b05c393431c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1c17c2c280945aeadcf3b05c393431c 2023-03-28 05:53:57,899 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1c17c2c280945aeadcf3b05c393431c, entries=1, sequenceid=17, filesize=4.9 K 2023-03-28 05:53:57,900 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 445ms, sequenceid=17, compaction requested=true 2023-03-28 05:53:57,900 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:57,901 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:57,903 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,903 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:57,904 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,904 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:57,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:57,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:57,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:57,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:57,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d0a47c9[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:57,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:57,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,909 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,909 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:57,909 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:57,909 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:57,909 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,909 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:57,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:57,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:57,911 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:57,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:57,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:57,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:57,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:57,917 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:57,917 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:57,917 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:57,917 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,917 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:57,919 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,919 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,919 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:57,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:57,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:57,921 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:57,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,923 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:57,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,927 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:57,927 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:57,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:57,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:57,927 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,927 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,927 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,927 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:57,927 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:57,928 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:57,928 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:57,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:57,927 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:57,929 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:57,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:53:57,929 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:57,929 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:57,929 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,029 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:58,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:58,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:58,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:58,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,041 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:58,041 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:58,041 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:58,041 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:58,043 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,043 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,053 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:58,053 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:58,054 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,054 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,055 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,056 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:58,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,056 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:58,056 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:58,057 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:58,060 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:58,060 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:58,060 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:58,060 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:58,060 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:58,143 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:53:58,496 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228df0ce6194e814b64bdbb4e198bfa837a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228df0ce6194e814b64bdbb4e198bfa837a 2023-03-28 05:53:58,504 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/b107ab5ca0234bd095335dedf0f2e5d1 2023-03-28 05:53:58,513 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/b107ab5ca0234bd095335dedf0f2e5d1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/b107ab5ca0234bd095335dedf0f2e5d1 2023-03-28 05:53:58,520 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/b107ab5ca0234bd095335dedf0f2e5d1, entries=1, sequenceid=21, filesize=4.9 K 2023-03-28 05:53:58,522 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 462ms, sequenceid=21, compaction requested=true 2023-03-28 05:53:58,522 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:58,522 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:58,522 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:58,524 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,524 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:58,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:58,524 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,524 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:58,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:58,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:58,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc7d66a[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:58,527 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:58,527 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,529 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,529 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:58,529 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:58,529 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:58,529 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,529 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:58,531 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,531 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:58,531 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:58,531 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:58,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:58,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:58,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:58,536 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:58,536 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:58,536 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:58,536 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,536 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:58,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:58,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:58,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:58,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:58,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:58,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:58,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:58,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,550 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:58,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:58,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:58,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:58,554 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,555 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:58,555 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:58,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:58,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:58,656 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:58,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:58,667 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:58,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:58,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,669 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:58,669 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:58,670 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:58,670 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:58,670 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,670 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,672 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,672 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:58,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:58,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:58,672 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:58,673 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:58,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:58,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:58,674 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:58,674 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:58,675 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:58,676 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:58,676 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:58,684 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:58,684 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:58,684 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:58,708 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cfefffa7f3154c949b4ccc649ed805d6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cfefffa7f3154c949b4ccc649ed805d6 2023-03-28 05:53:59,115 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/470d60db4bb74ecdb69dd288eed89b8e 2023-03-28 05:53:59,122 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/470d60db4bb74ecdb69dd288eed89b8e as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/470d60db4bb74ecdb69dd288eed89b8e 2023-03-28 05:53:59,128 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/470d60db4bb74ecdb69dd288eed89b8e, entries=1, sequenceid=25, filesize=4.9 K 2023-03-28 05:53:59,129 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 445ms, sequenceid=25, compaction requested=true 2023-03-28 05:53:59,130 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:59,130 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:59,130 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:59,131 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@584e8c08[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:59,134 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:59,134 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,136 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,136 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:59,136 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:59,136 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:59,136 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,137 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:59,138 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,138 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:59,141 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:59,141 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:59,142 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:59,142 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,142 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:59,143 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,143 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,143 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:59,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,144 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,145 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,148 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,148 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,148 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,148 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:59,148 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:59,148 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,149 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,149 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,148 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:59,149 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:59,149 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:53:59,149 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:59,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:59,149 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:59,150 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:59,150 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:59,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:59,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:59,250 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:59,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:59,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:59,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:59,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,262 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:59,262 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:59,263 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:59,263 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:59,264 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,264 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,266 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:59,266 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:59,267 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,267 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,268 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:59,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,268 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:59,268 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:59,268 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:59,269 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:59,269 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:59,269 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:59,269 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:59,269 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:59,287 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c0ca260a7b25433a93e9040773d71fce to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c0ca260a7b25433a93e9040773d71fce 2023-03-28 05:53:59,294 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/cdb1116ad4b548a3ba64d1ed7995c64f 2023-03-28 05:53:59,300 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/cdb1116ad4b548a3ba64d1ed7995c64f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/cdb1116ad4b548a3ba64d1ed7995c64f 2023-03-28 05:53:59,307 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/cdb1116ad4b548a3ba64d1ed7995c64f, entries=1, sequenceid=29, filesize=4.9 K 2023-03-28 05:53:59,308 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 39ms, sequenceid=29, compaction requested=true 2023-03-28 05:53:59,308 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:59,308 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:59,308 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:59,311 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,311 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,311 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,312 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:59,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bc78992[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:59,314 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:59,314 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,315 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:59,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:59,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:59,315 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,316 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:59,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:59,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:59,317 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:59,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:59,321 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:59,321 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:59,321 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:59,321 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,321 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:59,326 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,326 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:59,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:59,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:59,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,326 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,327 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,329 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:59,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:59,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:59,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:59,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:59,332 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:59,332 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,333 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:59,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:59,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:53:59,433 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:59,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:59,443 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:59,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:59,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,445 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:59,445 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:59,446 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:59,446 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:59,446 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,446 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,448 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,449 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,449 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:59,452 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:59,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,454 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,454 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:59,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,456 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:59,456 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:59,456 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:59,457 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:59,457 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:59,457 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:59,457 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:59,457 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:53:59,503 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037d7fc329115f449cad5988d62871ed01 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037d7fc329115f449cad5988d62871ed01 2023-03-28 05:53:59,525 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/c8c72679ebbb4f618d8962dc1526c9b6 2023-03-28 05:53:59,531 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/c8c72679ebbb4f618d8962dc1526c9b6 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/c8c72679ebbb4f618d8962dc1526c9b6 2023-03-28 05:53:59,538 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/c8c72679ebbb4f618d8962dc1526c9b6, entries=1, sequenceid=33, filesize=4.9 K 2023-03-28 05:53:59,539 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 82ms, sequenceid=33, compaction requested=true 2023-03-28 05:53:59,539 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:53:59,539 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:53:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:53:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:53:59,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:53:59,541 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,542 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,542 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:53:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:53:59,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@344cb32c[Count = 0] remaining members to acquire global barrier 2023-03-28 05:53:59,544 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:53:59,544 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,546 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:53:59,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:53:59,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:53:59,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:53:59,550 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:53:59,550 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:59,550 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,550 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:53:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:53:59,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:53:59,553 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:53:59,554 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:53:59,554 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:53:59,554 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,554 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:53:59,556 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,556 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:53:59,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:53:59,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,556 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:59,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:53:59,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:59,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:59,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:53:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:53:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:59,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:53:59,562 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:53:59,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,563 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:59,563 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:53:59,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:59,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:53:59,563 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,563 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:53:59,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:59,563 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:53:59,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:53:59,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:53:59,663 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:53:59,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:53:59,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:53:59,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:53:59,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,673 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:53:59,673 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:59,674 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:53:59,674 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:53:59,674 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,675 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,676 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:53:59,676 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:53:59,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:53:59,676 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:53:59,677 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:53:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:53:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,678 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:53:59,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:53:59,678 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:53:59,678 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:53:59,678 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:53:59,679 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:53:59,679 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:53:59,679 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:53:59,679 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:53:59,679 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:00,118 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e5ce6b84332844df9e888d8378c5ac75 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907e5ce6b84332844df9e888d8378c5ac75 2023-03-28 05:54:00,525 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/aa0d1a43e4a745f68b758a488bd35b1d 2023-03-28 05:54:00,532 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/aa0d1a43e4a745f68b758a488bd35b1d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/aa0d1a43e4a745f68b758a488bd35b1d 2023-03-28 05:54:00,538 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/aa0d1a43e4a745f68b758a488bd35b1d, entries=1, sequenceid=37, filesize=4.9 K 2023-03-28 05:54:00,539 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 860ms, sequenceid=37, compaction requested=true 2023-03-28 05:54:00,539 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:54:00,539 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:54:00,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:00,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:00,539 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,540 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:54:00,540 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:54:00,541 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:00,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,542 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:00,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:00,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:00,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:00,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:54:00,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21ad5749[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:00,544 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:00,544 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,546 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:00,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:00,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:54:00,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:00,549 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:54:00,549 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,549 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:00,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:00,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:00,549 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:54:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:00,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:00,552 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:54:00,552 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:00,552 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:00,552 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,552 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:00,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,554 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:00,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:00,555 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,559 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,559 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:00,559 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:00,559 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,559 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,559 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:00,559 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:00,559 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,560 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,560 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:54:00,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:00,561 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:00,561 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:00,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:54:00,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:00,661 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:00,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:00,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:00,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:00,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,675 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:54:00,675 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:00,675 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:54:00,675 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:00,676 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,676 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,677 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:00,677 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:00,678 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,678 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:00,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:54:00,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,679 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:54:00,679 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:54:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:00,681 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:00,681 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:54:00,681 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. started... 2023-03-28 05:54:00,681 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 51ab46570fba25557380b69853bf5ba6 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:00,700 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a11441e62de34ec2b504b865b27498e8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a11441e62de34ec2b504b865b27498e8 2023-03-28 05:54:00,707 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/69ff0501436f4125996969b7895eec14 2023-03-28 05:54:00,712 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/69ff0501436f4125996969b7895eec14 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/69ff0501436f4125996969b7895eec14 2023-03-28 05:54:00,718 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/69ff0501436f4125996969b7895eec14, entries=1, sequenceid=41, filesize=4.9 K 2023-03-28 05:54:00,719 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 51ab46570fba25557380b69853bf5ba6 in 38ms, sequenceid=41, compaction requested=true 2023-03-28 05:54:00,719 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:54:00,719 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:54:00,719 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:00,719 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:54:00,720 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:54:00,722 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,722 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:00,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:00,723 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,723 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:00,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:00,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:00,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:00,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:54:00,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@dafb1b8[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:00,725 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:00,725 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,726 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,726 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:00,726 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:54:00,726 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,726 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:00,726 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:00,728 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,728 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:54:00,729 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:00,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:00,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:00,729 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:54:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:00,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:00,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:00,732 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:54:00,732 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:00,732 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:00,732 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,732 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:00,734 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,734 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:00,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:00,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,734 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:00,734 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:00,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:00,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:00,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:00,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,736 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:00,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:00,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:00,740 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:00,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:00,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-28 05:54:00,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:00,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:00,742 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:00,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:54:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:00,742 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,742 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:00,742 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:00,742 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,842 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:00,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:00,845 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-28 05:54:00,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:00,848 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:00,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:00,850 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983440850 2023-03-28 05:54:00,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:00,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-28 05:54:00,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:00,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x5d1a3218 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:00,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29687949, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:00,866 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:01,331 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d15ff7c7de4a4c5f8104d311e2f60153 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103d15ff7c7de4a4c5f8104d311e2f60153 2023-03-28 05:54:01,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:01,348 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:01,350 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51078, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:01,361 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:01,363 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:01,382 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d0c24bcca9f1470ea19617fe556f8a7f first=Optional[r5] last=Optional[r6] 2023-03-28 05:54:01,382 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d0c24bcca9f1470ea19617fe556f8a7f}] 2023-03-28 05:54:01,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d0c24bcca9f1470ea19617fe556f8a7f for inclusion in 51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:54:01,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-28 05:54:01,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:01,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:54:01,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d0c24bcca9f1470ea19617fe556f8a7f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d1lih1mlhar00e4k5mogiuofb29c2lnrrghr1rcgm39hf8ca4vud5glt9bs1mch2/family1/d0c24bcca9f1470ea19617fe556f8a7f 2023-03-28 05:54:01,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d1lih1mlhar00e4k5mogiuofb29c2lnrrghr1rcgm39hf8ca4vud5glt9bs1mch2/family1/d0c24bcca9f1470ea19617fe556f8a7f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_ 2023-03-28 05:54:01,406 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d1lih1mlhar00e4k5mogiuofb29c2lnrrghr1rcgm39hf8ca4vud5glt9bs1mch2/family1/d0c24bcca9f1470ea19617fe556f8a7f into 51ab46570fba25557380b69853bf5ba6/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_ - updating store file list. 2023-03-28 05:54:01,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_ into 51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:54:01,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d1lih1mlhar00e4k5mogiuofb29c2lnrrghr1rcgm39hf8ca4vud5glt9bs1mch2/family1/d0c24bcca9f1470ea19617fe556f8a7f into 51ab46570fba25557380b69853bf5ba6/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_) 2023-03-28 05:54:01,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d1lih1mlhar00e4k5mogiuofb29c2lnrrghr1rcgm39hf8ca4vud5glt9bs1mch2/family1/d0c24bcca9f1470ea19617fe556f8a7f 2023-03-28 05:54:01,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-28 05:54:01,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-28 05:54:01,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 51ab46570fba25557380b69853bf5ba6/family1 is initiating minor compaction 2023-03-28 05:54:01,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5e0bdcda; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:01,421 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 51ab46570fba25557380b69853bf5ba6/family1 in testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:54:01,422 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/3f2f59b9cb714f5f975b820473e8d695, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d6b21e56fb6f436db588f3978cfd70d2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1c17c2c280945aeadcf3b05c393431c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/b107ab5ca0234bd095335dedf0f2e5d1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/470d60db4bb74ecdb69dd288eed89b8e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/cdb1116ad4b548a3ba64d1ed7995c64f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/c8c72679ebbb4f618d8962dc1526c9b6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/aa0d1a43e4a745f68b758a488bd35b1d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/69ff0501436f4125996969b7895eec14, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp, totalSize=49.7 K 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 3f2f59b9cb714f5f975b820473e8d695, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting d6b21e56fb6f436db588f3978cfd70d2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting d1c17c2c280945aeadcf3b05c393431c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting b107ab5ca0234bd095335dedf0f2e5d1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 470d60db4bb74ecdb69dd288eed89b8e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting cdb1116ad4b548a3ba64d1ed7995c64f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting c8c72679ebbb4f618d8962dc1526c9b6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting aa0d1a43e4a745f68b758a488bd35b1d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-28 05:54:01,422 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 69ff0501436f4125996969b7895eec14, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-28 05:54:01,423 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-28 05:54:01,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:01,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:01,430 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c0ca260a7b25433a93e9040773d71fce to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c0ca260a7b25433a93e9040773d71fce 2023-03-28 05:54:01,433 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037d7fc329115f449cad5988d62871ed01 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037d7fc329115f449cad5988d62871ed01 2023-03-28 05:54:01,433 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-28 05:54:01,433 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-28 05:54:01,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:01,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:01,484 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 51ab46570fba25557380b69853bf5ba6#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:01,960 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/a79c89b626a4409b9ab360ab958e3658 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/a79c89b626a4409b9ab360ab958e3658 2023-03-28 05:54:01,969 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 51ab46570fba25557380b69853bf5ba6/family1 of 51ab46570fba25557380b69853bf5ba6 into a79c89b626a4409b9ab360ab958e3658(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:01,969 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:54:01,970 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679982841421; duration=0sec 2023-03-28 05:54:01,970 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:01,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/3f2f59b9cb714f5f975b820473e8d695, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d6b21e56fb6f436db588f3978cfd70d2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1c17c2c280945aeadcf3b05c393431c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/b107ab5ca0234bd095335dedf0f2e5d1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/470d60db4bb74ecdb69dd288eed89b8e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/cdb1116ad4b548a3ba64d1ed7995c64f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/c8c72679ebbb4f618d8962dc1526c9b6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/aa0d1a43e4a745f68b758a488bd35b1d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/69ff0501436f4125996969b7895eec14, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_] to archive 2023-03-28 05:54:02,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:02,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/3f2f59b9cb714f5f975b820473e8d695 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/3f2f59b9cb714f5f975b820473e8d695 2023-03-28 05:54:02,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d6b21e56fb6f436db588f3978cfd70d2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d6b21e56fb6f436db588f3978cfd70d2 2023-03-28 05:54:02,015 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e384ece5586d474f8486ad70714fe53c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e384ece5586d474f8486ad70714fe53c 2023-03-28 05:54:02,017 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:02,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1c17c2c280945aeadcf3b05c393431c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1c17c2c280945aeadcf3b05c393431c 2023-03-28 05:54:02,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/b107ab5ca0234bd095335dedf0f2e5d1 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/b107ab5ca0234bd095335dedf0f2e5d1 2023-03-28 05:54:02,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/470d60db4bb74ecdb69dd288eed89b8e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/470d60db4bb74ecdb69dd288eed89b8e 2023-03-28 05:54:02,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/cdb1116ad4b548a3ba64d1ed7995c64f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/cdb1116ad4b548a3ba64d1ed7995c64f 2023-03-28 05:54:02,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/c8c72679ebbb4f618d8962dc1526c9b6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/c8c72679ebbb4f618d8962dc1526c9b6 2023-03-28 05:54:02,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/aa0d1a43e4a745f68b758a488bd35b1d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/aa0d1a43e4a745f68b758a488bd35b1d 2023-03-28 05:54:02,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/69ff0501436f4125996969b7895eec14 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/69ff0501436f4125996969b7895eec14 2023-03-28 05:54:02,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/2cdb9bfb452f43a5b945068053b83cf3_SeqId_44_ 2023-03-28 05:54:02,055 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c3588e750a6042e6862697f13b0481ac first=Optional[r1] last=Optional[r4] 2023-03-28 05:54:02,056 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c3588e750a6042e6862697f13b0481ac}] 2023-03-28 05:54:02,060 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c3588e750a6042e6862697f13b0481ac for inclusion in 51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:54:02,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-28 05:54:02,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:02,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:54:02,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c3588e750a6042e6862697f13b0481ac to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gvfdv6nbjmppg19v3usan53inkn29kjlnjleukbhirior37j09276t1loo07vspv/family1/c3588e750a6042e6862697f13b0481ac 2023-03-28 05:54:02,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gvfdv6nbjmppg19v3usan53inkn29kjlnjleukbhirior37j09276t1loo07vspv/family1/c3588e750a6042e6862697f13b0481ac as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_ 2023-03-28 05:54:02,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gvfdv6nbjmppg19v3usan53inkn29kjlnjleukbhirior37j09276t1loo07vspv/family1/c3588e750a6042e6862697f13b0481ac into 51ab46570fba25557380b69853bf5ba6/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_ - updating store file list. 2023-03-28 05:54:02,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_ into 51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:54:02,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gvfdv6nbjmppg19v3usan53inkn29kjlnjleukbhirior37j09276t1loo07vspv/family1/c3588e750a6042e6862697f13b0481ac into 51ab46570fba25557380b69853bf5ba6/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_) 2023-03-28 05:54:02,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gvfdv6nbjmppg19v3usan53inkn29kjlnjleukbhirior37j09276t1loo07vspv/family1/c3588e750a6042e6862697f13b0481ac 2023-03-28 05:54:02,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-28 05:54:02,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-28 05:54:02,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 51ab46570fba25557380b69853bf5ba6/family1 is initiating minor compaction (all files) 2023-03-28 05:54:02,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5fb443f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:02,084 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 51ab46570fba25557380b69853bf5ba6/family1 in testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:54:02,084 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1812e63bdbd404d91c1eaac31989c05, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/a79c89b626a4409b9ab360ab958e3658, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp, totalSize=178.1 K 2023-03-28 05:54:02,085 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting d1812e63bdbd404d91c1eaac31989c05, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843296 2023-03-28 05:54:02,086 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a79c89b626a4409b9ab360ab958e3658, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243296 2023-03-28 05:54:02,086 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965243296 2023-03-28 05:54:02,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:02,089 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:02,092 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201867ac35ebb0244359836a62b9061475a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201867ac35ebb0244359836a62b9061475a 2023-03-28 05:54:02,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205b95f2e5f46584f6bbc0e761edd62360d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205b95f2e5f46584f6bbc0e761edd62360d 2023-03-28 05:54:02,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228df0ce6194e814b64bdbb4e198bfa837a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228df0ce6194e814b64bdbb4e198bfa837a 2023-03-28 05:54:02,103 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cfefffa7f3154c949b4ccc649ed805d6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cfefffa7f3154c949b4ccc649ed805d6 2023-03-28 05:54:02,103 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-28 05:54:02,103 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-28 05:54:02,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:02,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:02,119 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 51ab46570fba25557380b69853bf5ba6#family1#compaction#23 average throughput is 9.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:02,225 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/.tmp/family1/16e865ce3bd449c9a752ac351f8ba115 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/16e865ce3bd449c9a752ac351f8ba115 2023-03-28 05:54:02,230 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301b293247761a470cb7e6b7e5752c4e6b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511301b293247761a470cb7e6b7e5752c4e6b 2023-03-28 05:54:02,232 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:02,234 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 51ab46570fba25557380b69853bf5ba6/family1 of 51ab46570fba25557380b69853bf5ba6 into 16e865ce3bd449c9a752ac351f8ba115(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:02,235 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:54:02,235 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1679982842084; duration=0sec 2023-03-28 05:54:02,235 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:02,261 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34938a51073244cb8b85f0691bf3db94 first=Optional[r00] last=Optional[r8] 2023-03-28 05:54:02,261 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34938a51073244cb8b85f0691bf3db94}] 2023-03-28 05:54:02,264 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34938a51073244cb8b85f0691bf3db94 for inclusion in 51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:54:02,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1812e63bdbd404d91c1eaac31989c05, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/a79c89b626a4409b9ab360ab958e3658, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_] to archive 2023-03-28 05:54:02,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-28 05:54:02,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:02,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:02,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:54:02,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34938a51073244cb8b85f0691bf3db94 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v1dc2299igsref8u54hacdl39bc6escjfojdg0thg2ca51qqo1gpfusg0uqgf1pb/family1/34938a51073244cb8b85f0691bf3db94 2023-03-28 05:54:02,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1812e63bdbd404d91c1eaac31989c05 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/d1812e63bdbd404d91c1eaac31989c05 2023-03-28 05:54:02,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/a79c89b626a4409b9ab360ab958e3658 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/a79c89b626a4409b9ab360ab958e3658 2023-03-28 05:54:02,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v1dc2299igsref8u54hacdl39bc6escjfojdg0thg2ca51qqo1gpfusg0uqgf1pb/family1/34938a51073244cb8b85f0691bf3db94 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/6b09be08c88f4b7eb86899e07d1a4d86_SeqId_50_ 2023-03-28 05:54:02,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/bdb10e0e9b464a69be44a17820ffd7fe_SeqId_47_ 2023-03-28 05:54:02,281 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v1dc2299igsref8u54hacdl39bc6escjfojdg0thg2ca51qqo1gpfusg0uqgf1pb/family1/34938a51073244cb8b85f0691bf3db94 into 51ab46570fba25557380b69853bf5ba6/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/6b09be08c88f4b7eb86899e07d1a4d86_SeqId_50_ - updating store file list. 2023-03-28 05:54:02,287 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/6b09be08c88f4b7eb86899e07d1a4d86_SeqId_50_ into 51ab46570fba25557380b69853bf5ba6/family1 2023-03-28 05:54:02,287 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v1dc2299igsref8u54hacdl39bc6escjfojdg0thg2ca51qqo1gpfusg0uqgf1pb/family1/34938a51073244cb8b85f0691bf3db94 into 51ab46570fba25557380b69853bf5ba6/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/family1/6b09be08c88f4b7eb86899e07d1a4d86_SeqId_50_) 2023-03-28 05:54:02,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__v1dc2299igsref8u54hacdl39bc6escjfojdg0thg2ca51qqo1gpfusg0uqgf1pb/family1/34938a51073244cb8b85f0691bf3db94 2023-03-28 05:54:02,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:02,292 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:02,295 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a11441e62de34ec2b504b865b27498e8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a11441e62de34ec2b504b865b27498e8 2023-03-28 05:54:02,298 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511284b6dbec19ae34d639db3cd883c262b80 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511284b6dbec19ae34d639db3cd883c262b80 2023-03-28 05:54:02,300 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308b4f42eb06de41efb0e79b984c6318c5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308b4f42eb06de41efb0e79b984c6318c5 2023-03-28 05:54:02,300 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-28 05:54:02,300 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-28 05:54:02,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:02,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:02,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:54:02,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:54:02,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:02,303 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:02,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4570 sec 2023-03-28 05:54:02,431 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=261 (was 252) Potentially hanging thread: hconnection-0x4596ad4a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78cb3fed-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49090 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49126 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52862 [Waiting for operation #27] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x5d1a3218 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1012498932.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49140 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78cb3fed-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53024 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:53052 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49042 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78cb3fed-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49194 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78cb3fed-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x5d1a3218-SendThread(127.0.0.1:58236) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1699592305_15 at /127.0.0.1:49054 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49000 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:48984 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1699592305_15 at /127.0.0.1:49110 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:48968 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58236@0x5d1a3218-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x78cb3fed-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:52980 [Waiting for operation #33] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49104 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49068 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78cb3fed-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4596ad4a-shared-pool-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78cb3fed-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_600474363_15 at /127.0.0.1:49086 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4596ad4a-shared-pool-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=620 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=447 (was 465), ProcessCount=172 (was 172), AvailableMemoryMB=4625 (was 4716) 2023-03-28 05:54:02,447 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=261, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=447, ProcessCount=172, AvailableMemoryMB=4624 2023-03-28 05:54:02,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-28 05:54:02,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:02,458 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:54:02,458 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-28 05:54:02,459 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:54:02,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-28 05:54:02,461 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:02,462 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4 empty. 2023-03-28 05:54:02,463 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:02,463 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-28 05:54:02,485 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:02,486 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => afa94645be6bd970c21b5ea8be00e4e4, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:02,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-28 05:54:02,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-28 05:54:02,898 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:02,898 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing afa94645be6bd970c21b5ea8be00e4e4, disabling compactions & flushes 2023-03-28 05:54:02,898 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:02,898 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:02,898 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. after waiting 0 ms 2023-03-28 05:54:02,898 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:02,898 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:02,898 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:02,901 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:54:02,902 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679982842902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982842902"}]},"ts":"1679982842902"} 2023-03-28 05:54:02,904 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:54:02,905 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:54:02,905 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982842905"}]},"ts":"1679982842905"} 2023-03-28 05:54:02,906 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-28 05:54:02,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afa94645be6bd970c21b5ea8be00e4e4, ASSIGN}] 2023-03-28 05:54:02,915 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afa94645be6bd970c21b5ea8be00e4e4, ASSIGN 2023-03-28 05:54:02,915 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afa94645be6bd970c21b5ea8be00e4e4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:03,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-28 05:54:03,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=afa94645be6bd970c21b5ea8be00e4e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:03,067 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679982843066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982843066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982843066"}]},"ts":"1679982843066"} 2023-03-28 05:54:03,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure afa94645be6bd970c21b5ea8be00e4e4, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:03,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:03,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => afa94645be6bd970c21b5ea8be00e4e4, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:03,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:03,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:03,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:03,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:03,227 INFO [StoreOpener-afa94645be6bd970c21b5ea8be00e4e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:03,229 DEBUG [StoreOpener-afa94645be6bd970c21b5ea8be00e4e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1 2023-03-28 05:54:03,229 DEBUG [StoreOpener-afa94645be6bd970c21b5ea8be00e4e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1 2023-03-28 05:54:03,230 INFO [StoreOpener-afa94645be6bd970c21b5ea8be00e4e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afa94645be6bd970c21b5ea8be00e4e4 columnFamilyName family1 2023-03-28 05:54:03,233 INFO [StoreOpener-afa94645be6bd970c21b5ea8be00e4e4-1] regionserver.HStore(310): Store=afa94645be6bd970c21b5ea8be00e4e4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:03,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:03,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:03,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:54:03,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:03,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened afa94645be6bd970c21b5ea8be00e4e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72051631, jitterRate=0.0736529678106308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:03,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:03,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4., pid=25, masterSystemTime=1679982843221 2023-03-28 05:54:03,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:03,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:03,254 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=afa94645be6bd970c21b5ea8be00e4e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:03,254 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679982843254"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982843254"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982843254"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982843254"}]},"ts":"1679982843254"} 2023-03-28 05:54:03,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-28 05:54:03,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure afa94645be6bd970c21b5ea8be00e4e4, server=jenkins-hbase4.apache.org,39167,1679982818904 in 188 msec 2023-03-28 05:54:03,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-28 05:54:03,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afa94645be6bd970c21b5ea8be00e4e4, ASSIGN in 346 msec 2023-03-28 05:54:03,262 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:54:03,263 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982843262"}]},"ts":"1679982843262"} 2023-03-28 05:54:03,264 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-28 05:54:03,267 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:54:03,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 813 msec 2023-03-28 05:54:03,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-28 05:54:03,565 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-28 05:54:03,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:03,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,587 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:03,587 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:03,587 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:03,587 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:03,588 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,588 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,589 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:03,589 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:03,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:03,590 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:03,590 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:03,591 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:03,591 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:03,591 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:03,591 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:03,591 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:03,591 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:03,591 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:03,592 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-28 05:54:04,015 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303e18b127b9074961a92b2a70d9fab256 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511303e18b127b9074961a92b2a70d9fab256 2023-03-28 05:54:04,419 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/eef25634a19b42648148333dfb53ccd4 2023-03-28 05:54:04,425 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/eef25634a19b42648148333dfb53ccd4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/eef25634a19b42648148333dfb53ccd4 2023-03-28 05:54:04,430 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/eef25634a19b42648148333dfb53ccd4, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-28 05:54:04,431 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 839ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:04,431 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:04,431 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:04,431 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:04,431 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:04,432 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:04,432 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,432 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:04,432 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:04,433 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,433 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:04,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:04,434 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,434 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:04,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:04,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:04,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:04,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:04,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a132286[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:04,435 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:04,435 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,436 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,436 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:04,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:04,439 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:04,439 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,439 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:04,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,439 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:04,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:04,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:04,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:04,441 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:04,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:04,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:04,442 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,442 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:04,443 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,443 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:04,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,443 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:04,444 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,445 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:04,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,447 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,447 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:04,447 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,447 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:04,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:04,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:04,447 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:04,447 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:04,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:04,447 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,448 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:04,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:04,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:04,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,448 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:04,548 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:04,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:04,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:04,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:04,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,556 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:04,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:04,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:04,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:04,557 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,557 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,558 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:04,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:04,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:04,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:04,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:04,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:04,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:04,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:04,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:04,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:04,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:04,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:04,560 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:04,560 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:04,560 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-28 05:54:04,974 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112898f33ec2fdbd4e0da7863b32215beb7b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112898f33ec2fdbd4e0da7863b32215beb7b 2023-03-28 05:54:05,380 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/86025da8f9804042b9eac1129b4d7876 2023-03-28 05:54:05,386 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/86025da8f9804042b9eac1129b4d7876 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/86025da8f9804042b9eac1129b4d7876 2023-03-28 05:54:05,390 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/86025da8f9804042b9eac1129b4d7876, entries=1, sequenceid=9, filesize=5.0 K 2023-03-28 05:54:05,391 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 831ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:05,391 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:05,391 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:05,391 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:05,394 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,394 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:05,394 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,394 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:05,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:05,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b17233b[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:05,396 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:05,396 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,397 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:05,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:05,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:05,397 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,397 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:05,399 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:05,399 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,399 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:05,399 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:05,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:05,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:05,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:05,401 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:05,401 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:05,401 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:05,401 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,401 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:05,403 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,403 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:05,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,403 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:05,404 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:05,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:05,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:05,409 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:05,409 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,409 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:05,409 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,509 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:05,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:05,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:05,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:05,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,516 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:05,517 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:05,517 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:05,517 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:05,517 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,517 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,518 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,518 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:05,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:05,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:05,519 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:05,519 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:05,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:05,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,520 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,520 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:05,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:05,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:05,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:05,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:05,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:05,520 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:05,520 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:05,520 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:05,520 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:05,934 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201db882924bf99432e9c20bbe18ff1cf58 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201db882924bf99432e9c20bbe18ff1cf58 2023-03-28 05:54:06,339 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/12459bb4d3ae48459471e245b293049d 2023-03-28 05:54:06,346 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/12459bb4d3ae48459471e245b293049d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/12459bb4d3ae48459471e245b293049d 2023-03-28 05:54:06,351 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/12459bb4d3ae48459471e245b293049d, entries=1, sequenceid=13, filesize=4.9 K 2023-03-28 05:54:06,352 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 832ms, sequenceid=13, compaction requested=true 2023-03-28 05:54:06,352 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:06,352 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:06,352 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:06,352 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:06,352 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,352 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:06,352 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:06,354 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,354 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:06,354 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,354 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:06,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@204b360f[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:06,355 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:06,355 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,357 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,357 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:06,357 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:06,357 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:06,357 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,357 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:06,359 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:06,359 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,359 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:06,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:06,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:06,359 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:06,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:06,361 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:06,361 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:06,361 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:06,361 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,362 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:06,363 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,363 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,363 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:06,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:06,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:06,364 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,365 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,370 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,370 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:06,370 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:06,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:06,371 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:06,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:06,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:06,371 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:06,371 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,370 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:06,371 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:06,371 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,371 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:06,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:06,371 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:06,371 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,371 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,471 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:06,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:06,477 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:06,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:06,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,478 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:06,478 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:06,478 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:06,478 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:06,479 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,479 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,480 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:06,480 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:06,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:06,480 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:06,481 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,481 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:06,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:06,482 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:06,482 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:06,482 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:06,482 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:06,482 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:06,482 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:06,482 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:06,482 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:06,896 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a1155e7713ea4a2990510ad5e4bfa733 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a1155e7713ea4a2990510ad5e4bfa733 2023-03-28 05:54:07,302 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/875a2415d24b4fccb0c31b38793339c7 2023-03-28 05:54:07,308 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/875a2415d24b4fccb0c31b38793339c7 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/875a2415d24b4fccb0c31b38793339c7 2023-03-28 05:54:07,312 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/875a2415d24b4fccb0c31b38793339c7, entries=1, sequenceid=17, filesize=4.9 K 2023-03-28 05:54:07,313 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 831ms, sequenceid=17, compaction requested=true 2023-03-28 05:54:07,314 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:07,314 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:07,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:07,316 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:07,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:07,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@501971cf[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:07,317 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:07,317 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,320 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:07,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:07,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:07,320 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,320 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:07,321 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:07,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:07,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:07,324 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:07,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:07,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:07,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,324 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:07,325 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,325 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:07,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,325 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:07,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:07,326 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,327 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:07,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,329 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:07,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:07,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:07,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:07,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:07,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,330 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:07,330 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:07,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:07,430 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:07,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:07,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:07,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:07,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,437 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:07,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:07,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:07,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:07,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,440 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,440 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:07,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:07,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:07,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:07,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:07,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,441 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,441 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:07,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:07,442 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:07,442 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:07,442 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:07,442 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:07,855 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122892f7be5a20fd41c29a99bc4db3e5920f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122892f7be5a20fd41c29a99bc4db3e5920f 2023-03-28 05:54:08,261 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/a13203af82094d759b2b2c577d990885 2023-03-28 05:54:08,267 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/a13203af82094d759b2b2c577d990885 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/a13203af82094d759b2b2c577d990885 2023-03-28 05:54:08,273 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/a13203af82094d759b2b2c577d990885, entries=1, sequenceid=21, filesize=4.9 K 2023-03-28 05:54:08,274 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 832ms, sequenceid=21, compaction requested=true 2023-03-28 05:54:08,274 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:08,274 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:08,274 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:08,276 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,276 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:08,276 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,276 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:08,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:08,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:08,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:08,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:08,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73bd7e58[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:08,278 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:08,278 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,279 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,279 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:08,279 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:08,279 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,279 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:08,279 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:08,281 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,281 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:08,281 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:08,281 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:08,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:08,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:08,284 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:08,284 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:08,284 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:08,284 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,284 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:08,291 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,291 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:08,291 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:08,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:08,292 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:08,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,293 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:08,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:08,296 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:08,296 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:08,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,296 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:08,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:08,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:08,297 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,396 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:08,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:08,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:08,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:08,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,405 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:08,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:08,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:08,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:08,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,406 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,406 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:08,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:08,407 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,407 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:08,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,408 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,408 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:08,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:08,408 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:08,408 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:08,409 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:08,409 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:08,423 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b97264c71c1b4ef696dd2e9b86cdd40a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231b97264c71c1b4ef696dd2e9b86cdd40a 2023-03-28 05:54:08,429 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/6b77196527ef41349e865f93c0f7aeec 2023-03-28 05:54:08,434 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/6b77196527ef41349e865f93c0f7aeec as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6b77196527ef41349e865f93c0f7aeec 2023-03-28 05:54:08,440 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6b77196527ef41349e865f93c0f7aeec, entries=1, sequenceid=25, filesize=4.9 K 2023-03-28 05:54:08,441 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 32ms, sequenceid=25, compaction requested=true 2023-03-28 05:54:08,441 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:08,441 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:08,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:08,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:08,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:08,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:08,443 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,443 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:08,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:08,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:08,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21e185ef[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:08,446 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:08,446 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,448 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,448 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:08,448 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:08,453 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,453 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:08,454 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:08,454 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:08,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:08,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:08,457 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:08,457 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:08,457 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:08,457 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,457 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:08,462 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,462 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:08,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,462 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:08,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:08,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:08,463 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,464 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,467 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,467 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:08,467 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:08,467 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:08,467 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:08,468 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:08,467 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:08,467 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:08,468 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,468 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,468 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,468 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,468 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:08,468 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:08,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:08,568 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:08,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:08,574 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:08,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:08,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,575 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:08,575 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:08,575 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:08,576 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:08,576 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,576 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,577 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:08,577 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:08,578 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:08,578 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,579 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:08,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:08,579 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:08,579 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:08,579 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:08,579 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:08,758 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:54:08,994 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010198999f4373174f85a070009f5a492e8e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010198999f4373174f85a070009f5a492e8e 2023-03-28 05:54:09,401 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/004e9ccde37c4143aa33a1c8f2954749 2023-03-28 05:54:09,407 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/004e9ccde37c4143aa33a1c8f2954749 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/004e9ccde37c4143aa33a1c8f2954749 2023-03-28 05:54:09,411 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/004e9ccde37c4143aa33a1c8f2954749, entries=1, sequenceid=29, filesize=4.9 K 2023-03-28 05:54:09,412 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 833ms, sequenceid=29, compaction requested=true 2023-03-28 05:54:09,412 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:09,412 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:09,413 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:09,414 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,414 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:09,415 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,415 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:09,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:09,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58e33492[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:09,416 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:09,416 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,417 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,417 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:09,417 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:09,418 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:09,417 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,418 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:09,420 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:09,420 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,420 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:09,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:09,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:09,420 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:09,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:09,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:09,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:09,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:09,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:09,422 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:09,422 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:09,422 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:09,422 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,422 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:09,424 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,424 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,424 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:09,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:09,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:09,424 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:09,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,426 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:09,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:09,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:09,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:09,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:09,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:09,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:09,429 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:09,529 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:09,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:09,535 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:09,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:09,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,536 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:09,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:09,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:09,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:09,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,538 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,538 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:09,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:09,539 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:09,539 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,540 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,540 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:09,540 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:09,540 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:09,540 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:09,540 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:09,540 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:09,540 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:09,540 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:09,540 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:09,954 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010314b7bb86e23447bdb3e3ea7212bb16ef to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010314b7bb86e23447bdb3e3ea7212bb16ef 2023-03-28 05:54:10,359 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/25d88a0705b84302990b84283527775c 2023-03-28 05:54:10,364 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/25d88a0705b84302990b84283527775c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/25d88a0705b84302990b84283527775c 2023-03-28 05:54:10,369 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/25d88a0705b84302990b84283527775c, entries=1, sequenceid=33, filesize=4.9 K 2023-03-28 05:54:10,370 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 830ms, sequenceid=33, compaction requested=true 2023-03-28 05:54:10,370 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:10,370 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:10,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:10,372 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,372 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:10,373 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,373 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:10,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:10,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436fb148[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:10,374 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:10,374 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,375 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,375 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:10,375 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,375 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:10,375 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:10,376 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:10,377 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:10,377 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:10,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:10,379 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:10,379 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:10,379 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:10,379 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,379 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:10,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:10,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:10,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:10,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:10,381 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:10,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:10,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:10,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,382 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:10,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:10,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:10,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:10,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:10,385 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:10,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:10,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,386 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:10,386 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:10,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:10,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:10,386 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,386 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,386 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,486 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:10,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:10,492 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:10,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:10,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,494 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:10,494 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:10,495 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:10,495 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:10,495 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,495 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,496 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:10,496 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:10,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:10,497 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:10,497 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:10,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:10,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,498 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,498 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:10,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:10,498 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:10,498 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:10,498 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:10,498 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:10,499 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:10,499 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:10,499 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:10,499 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:10,913 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907570c46bc80d34bb08f569995451a760e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907570c46bc80d34bb08f569995451a760e 2023-03-28 05:54:11,319 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/6e1dd5f2fcf0460d8a66657867b86851 2023-03-28 05:54:11,330 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/6e1dd5f2fcf0460d8a66657867b86851 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6e1dd5f2fcf0460d8a66657867b86851 2023-03-28 05:54:11,346 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6e1dd5f2fcf0460d8a66657867b86851, entries=1, sequenceid=37, filesize=4.9 K 2023-03-28 05:54:11,347 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 848ms, sequenceid=37, compaction requested=true 2023-03-28 05:54:11,347 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:11,347 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:11,347 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:11,347 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:11,347 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,347 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:11,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:11,351 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:11,352 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,352 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:11,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:11,354 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:11,354 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb858c3[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:11,360 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:11,361 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,361 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:11,362 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:11,363 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:11,366 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:11,366 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:11,366 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:11,366 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,366 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:11,369 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,369 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,369 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:11,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:11,370 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,372 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:11,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:11,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:11,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:11,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:11,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:11,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:11,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:11,379 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:11,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:11,379 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,379 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:11,379 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,379 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,379 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:11,380 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:11,380 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:11,480 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:11,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:11,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:11,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:11,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,496 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:11,496 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:11,496 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:11,496 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:11,497 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,497 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,499 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:11,499 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:11,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:11,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,501 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:11,501 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:11,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:11,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,502 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:11,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:11,502 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:11,502 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:11,502 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:11,504 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:11,504 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:11,504 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:11,504 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. started... 2023-03-28 05:54:11,504 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing afa94645be6bd970c21b5ea8be00e4e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:11,958 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d904175564c64a169499d8dc2f6f23d6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120d904175564c64a169499d8dc2f6f23d6 2023-03-28 05:54:12,365 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/040e5af91d5a48d38eb69aa4bdb947ba 2023-03-28 05:54:12,383 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/040e5af91d5a48d38eb69aa4bdb947ba as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/040e5af91d5a48d38eb69aa4bdb947ba 2023-03-28 05:54:12,395 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/040e5af91d5a48d38eb69aa4bdb947ba, entries=1, sequenceid=41, filesize=4.9 K 2023-03-28 05:54:12,396 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afa94645be6bd970c21b5ea8be00e4e4 in 892ms, sequenceid=41, compaction requested=true 2023-03-28 05:54:12,396 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:12,396 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:12,396 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:12,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:12,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:12,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:12,399 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,399 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:12,400 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,400 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:12,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@765b60a6[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:12,401 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:12,402 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,403 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,403 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,403 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:12,403 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:12,403 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:12,403 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:12,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,405 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:12,405 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:12,405 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:12,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:12,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:12,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:12,409 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:12,409 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:12,409 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:12,409 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,409 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:12,412 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,412 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:12,412 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:12,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:12,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:12,416 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:12,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,418 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:12,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,421 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,421 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,421 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:12,421 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:12,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-28 05:54:12,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:12,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:12,421 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:12,421 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,422 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:12,422 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,422 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,422 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:12,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:12,422 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:12,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:12,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:12,422 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:12,522 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:12,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:12,525 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-28 05:54:12,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:12,528 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:12,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:12,529 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983452529 2023-03-28 05:54:12,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-28 05:54:12,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-28 05:54:12,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:12,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x5045f8b2 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:12,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a8d71c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:12,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:12,993 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010383781503f6834333a03ff44e256dad0d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010383781503f6834333a03ff44e256dad0d 2023-03-28 05:54:12,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:13,013 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:13,014 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:13,026 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:13,030 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:13,044 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/044b977bf7ac4b74b40d6ebf175d7aee first=Optional[r3] last=Optional[r6] 2023-03-28 05:54:13,044 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/044b977bf7ac4b74b40d6ebf175d7aee}] 2023-03-28 05:54:13,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/044b977bf7ac4b74b40d6ebf175d7aee for inclusion in afa94645be6bd970c21b5ea8be00e4e4/family1 2023-03-28 05:54:13,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-28 05:54:13,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:13,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:13,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/044b977bf7ac4b74b40d6ebf175d7aee to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vu6v79f6fif7giqsa9b0650j3b2t82flmrlfmeetc4shsr79hibndi8dmr8uqnsm/family1/044b977bf7ac4b74b40d6ebf175d7aee 2023-03-28 05:54:13,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vu6v79f6fif7giqsa9b0650j3b2t82flmrlfmeetc4shsr79hibndi8dmr8uqnsm/family1/044b977bf7ac4b74b40d6ebf175d7aee as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_ 2023-03-28 05:54:13,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vu6v79f6fif7giqsa9b0650j3b2t82flmrlfmeetc4shsr79hibndi8dmr8uqnsm/family1/044b977bf7ac4b74b40d6ebf175d7aee into afa94645be6bd970c21b5ea8be00e4e4/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_ - updating store file list. 2023-03-28 05:54:13,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_ into afa94645be6bd970c21b5ea8be00e4e4/family1 2023-03-28 05:54:13,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vu6v79f6fif7giqsa9b0650j3b2t82flmrlfmeetc4shsr79hibndi8dmr8uqnsm/family1/044b977bf7ac4b74b40d6ebf175d7aee into afa94645be6bd970c21b5ea8be00e4e4/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_) 2023-03-28 05:54:13,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vu6v79f6fif7giqsa9b0650j3b2t82flmrlfmeetc4shsr79hibndi8dmr8uqnsm/family1/044b977bf7ac4b74b40d6ebf175d7aee 2023-03-28 05:54:13,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-28 05:54:13,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-28 05:54:13,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): afa94645be6bd970c21b5ea8be00e4e4/family1 is initiating minor compaction 2023-03-28 05:54:13,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d2ab826; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:13,091 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of afa94645be6bd970c21b5ea8be00e4e4/family1 in testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:13,091 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/86025da8f9804042b9eac1129b4d7876, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/12459bb4d3ae48459471e245b293049d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/875a2415d24b4fccb0c31b38793339c7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/a13203af82094d759b2b2c577d990885, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6b77196527ef41349e865f93c0f7aeec, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/004e9ccde37c4143aa33a1c8f2954749, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/25d88a0705b84302990b84283527775c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6e1dd5f2fcf0460d8a66657867b86851, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/040e5af91d5a48d38eb69aa4bdb947ba, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp, totalSize=50.0 K 2023-03-28 05:54:13,091 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 86025da8f9804042b9eac1129b4d7876, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:54:13,091 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 12459bb4d3ae48459471e245b293049d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:54:13,091 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 875a2415d24b4fccb0c31b38793339c7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-28 05:54:13,091 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a13203af82094d759b2b2c577d990885, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-28 05:54:13,091 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 6b77196527ef41349e865f93c0f7aeec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-28 05:54:13,091 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 004e9ccde37c4143aa33a1c8f2954749, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-28 05:54:13,091 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 25d88a0705b84302990b84283527775c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-28 05:54:13,092 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 6e1dd5f2fcf0460d8a66657867b86851, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-28 05:54:13,092 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 040e5af91d5a48d38eb69aa4bdb947ba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-28 05:54:13,092 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 262e61c36ee943a8842e213bbce7e682_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-28 05:54:13,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:13,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:13,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122892f7be5a20fd41c29a99bc4db3e5920f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122892f7be5a20fd41c29a99bc4db3e5920f 2023-03-28 05:54:13,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231b97264c71c1b4ef696dd2e9b86cdd40a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231b97264c71c1b4ef696dd2e9b86cdd40a 2023-03-28 05:54:13,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010198999f4373174f85a070009f5a492e8e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010198999f4373174f85a070009f5a492e8e 2023-03-28 05:54:13,102 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010314b7bb86e23447bdb3e3ea7212bb16ef to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010314b7bb86e23447bdb3e3ea7212bb16ef 2023-03-28 05:54:13,102 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-28 05:54:13,102 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,228 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): afa94645be6bd970c21b5ea8be00e4e4#family1#compaction#34 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:13,306 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/2cb6961794444f09852cf8ff139414da as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/2cb6961794444f09852cf8ff139414da 2023-03-28 05:54:13,317 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in afa94645be6bd970c21b5ea8be00e4e4/family1 of afa94645be6bd970c21b5ea8be00e4e4 into 2cb6961794444f09852cf8ff139414da(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:13,317 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:13,317 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679982853090; duration=0sec 2023-03-28 05:54:13,317 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:13,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/86025da8f9804042b9eac1129b4d7876, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/12459bb4d3ae48459471e245b293049d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/875a2415d24b4fccb0c31b38793339c7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/a13203af82094d759b2b2c577d990885, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6b77196527ef41349e865f93c0f7aeec, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/004e9ccde37c4143aa33a1c8f2954749, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/25d88a0705b84302990b84283527775c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6e1dd5f2fcf0460d8a66657867b86851, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/040e5af91d5a48d38eb69aa4bdb947ba, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_] to archive 2023-03-28 05:54:13,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:13,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/86025da8f9804042b9eac1129b4d7876 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/86025da8f9804042b9eac1129b4d7876 2023-03-28 05:54:13,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/12459bb4d3ae48459471e245b293049d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/12459bb4d3ae48459471e245b293049d 2023-03-28 05:54:13,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/875a2415d24b4fccb0c31b38793339c7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/875a2415d24b4fccb0c31b38793339c7 2023-03-28 05:54:13,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/a13203af82094d759b2b2c577d990885 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/a13203af82094d759b2b2c577d990885 2023-03-28 05:54:13,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6b77196527ef41349e865f93c0f7aeec to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6b77196527ef41349e865f93c0f7aeec 2023-03-28 05:54:13,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/004e9ccde37c4143aa33a1c8f2954749 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/004e9ccde37c4143aa33a1c8f2954749 2023-03-28 05:54:13,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/25d88a0705b84302990b84283527775c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/25d88a0705b84302990b84283527775c 2023-03-28 05:54:13,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6e1dd5f2fcf0460d8a66657867b86851 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/6e1dd5f2fcf0460d8a66657867b86851 2023-03-28 05:54:13,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/040e5af91d5a48d38eb69aa4bdb947ba to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/040e5af91d5a48d38eb69aa4bdb947ba 2023-03-28 05:54:13,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/262e61c36ee943a8842e213bbce7e682_SeqId_44_ 2023-03-28 05:54:13,599 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059e2993ffdc8d4bf5a322d60337500179 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512059e2993ffdc8d4bf5a322d60337500179 2023-03-28 05:54:13,600 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:13,633 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/06050283332a48fe9a6e46564c6c39c8 first=Optional[r1] last=Optional[r2] 2023-03-28 05:54:13,634 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/06050283332a48fe9a6e46564c6c39c8}] 2023-03-28 05:54:13,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/06050283332a48fe9a6e46564c6c39c8 for inclusion in afa94645be6bd970c21b5ea8be00e4e4/family1 2023-03-28 05:54:13,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-28 05:54:13,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:13,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:13,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/06050283332a48fe9a6e46564c6c39c8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ebrpejrmj36296uvp7cq7q4eee6qa60dnaef8f13c0d56gpkcqu09t7ku4vubodr/family1/06050283332a48fe9a6e46564c6c39c8 2023-03-28 05:54:13,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ebrpejrmj36296uvp7cq7q4eee6qa60dnaef8f13c0d56gpkcqu09t7ku4vubodr/family1/06050283332a48fe9a6e46564c6c39c8 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_ 2023-03-28 05:54:13,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ebrpejrmj36296uvp7cq7q4eee6qa60dnaef8f13c0d56gpkcqu09t7ku4vubodr/family1/06050283332a48fe9a6e46564c6c39c8 into afa94645be6bd970c21b5ea8be00e4e4/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_ - updating store file list. 2023-03-28 05:54:13,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_ into afa94645be6bd970c21b5ea8be00e4e4/family1 2023-03-28 05:54:13,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ebrpejrmj36296uvp7cq7q4eee6qa60dnaef8f13c0d56gpkcqu09t7ku4vubodr/family1/06050283332a48fe9a6e46564c6c39c8 into afa94645be6bd970c21b5ea8be00e4e4/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_) 2023-03-28 05:54:13,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ebrpejrmj36296uvp7cq7q4eee6qa60dnaef8f13c0d56gpkcqu09t7ku4vubodr/family1/06050283332a48fe9a6e46564c6c39c8 2023-03-28 05:54:13,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-28 05:54:13,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-28 05:54:13,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): afa94645be6bd970c21b5ea8be00e4e4/family1 is initiating minor compaction (all files) 2023-03-28 05:54:13,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3a46438f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:13,665 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of afa94645be6bd970c21b5ea8be00e4e4/family1 in testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:54:13,665 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/eef25634a19b42648148333dfb53ccd4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/2cb6961794444f09852cf8ff139414da, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp, totalSize=176.8 K 2023-03-28 05:54:13,665 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting eef25634a19b42648148333dfb53ccd4, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843296 2023-03-28 05:54:13,666 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 2cb6961794444f09852cf8ff139414da, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243296 2023-03-28 05:54:13,667 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 9a41a26a80ac411ebf50248ef1539078_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965243296 2023-03-28 05:54:13,668 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:13,669 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:13,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201db882924bf99432e9c20bbe18ff1cf58 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201db882924bf99432e9c20bbe18ff1cf58 2023-03-28 05:54:13,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a1155e7713ea4a2990510ad5e4bfa733 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a1155e7713ea4a2990510ad5e4bfa733 2023-03-28 05:54:13,673 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-28 05:54:13,673 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-28 05:54:13,685 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:13,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:13,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:13,686 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:13,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.1600 sec 2023-03-28 05:54:13,700 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): afa94645be6bd970c21b5ea8be00e4e4#family1#compaction#35 average throughput is 9.67 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:13,832 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=261 (was 261), OpenFileDescriptor=616 (was 620), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=378 (was 447), ProcessCount=171 (was 172), AvailableMemoryMB=4530 (was 4624) 2023-03-28 05:54:13,845 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=261, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=378, ProcessCount=171, AvailableMemoryMB=4529 2023-03-28 05:54:13,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-28 05:54:13,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:13,851 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:54:13,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-28 05:54:13,852 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:54:13,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-28 05:54:13,855 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:13,857 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:13,858 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326 empty. 2023-03-28 05:54:13,858 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:13,858 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa empty. 2023-03-28 05:54:13,860 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:13,860 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7 empty. 2023-03-28 05:54:13,860 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:13,861 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:13,861 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-28 05:54:13,878 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:13,880 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2ea176dc8596cbcf3c0937973953a326, NAME => 'testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:13,880 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 30e646cafaa19e2927fd54ee364189fa, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:13,881 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 9dfa29c5ad05861af620a7cc800187c7, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:13,912 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:13,912 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 30e646cafaa19e2927fd54ee364189fa, disabling compactions & flushes 2023-03-28 05:54:13,912 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:13,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:13,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. after waiting 0 ms 2023-03-28 05:54:13,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:13,913 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:13,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 30e646cafaa19e2927fd54ee364189fa: 2023-03-28 05:54:13,915 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:13,915 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 9dfa29c5ad05861af620a7cc800187c7, disabling compactions & flushes 2023-03-28 05:54:13,915 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:13,915 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:13,915 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. after waiting 0 ms 2023-03-28 05:54:13,915 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:13,915 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:13,915 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 9dfa29c5ad05861af620a7cc800187c7: 2023-03-28 05:54:13,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-28 05:54:14,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-28 05:54:14,303 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:14,303 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 2ea176dc8596cbcf3c0937973953a326, disabling compactions & flushes 2023-03-28 05:54:14,303 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,303 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,303 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. after waiting 0 ms 2023-03-28 05:54:14,303 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,303 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,303 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 2ea176dc8596cbcf3c0937973953a326: 2023-03-28 05:54:14,307 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:54:14,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679982854308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982854308"}]},"ts":"1679982854308"} 2023-03-28 05:54:14,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679982854308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982854308"}]},"ts":"1679982854308"} 2023-03-28 05:54:14,308 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679982854308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982854308"}]},"ts":"1679982854308"} 2023-03-28 05:54:14,311 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-28 05:54:14,312 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:54:14,312 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982854312"}]},"ts":"1679982854312"} 2023-03-28 05:54:14,314 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-28 05:54:14,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ea176dc8596cbcf3c0937973953a326, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30e646cafaa19e2927fd54ee364189fa, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9dfa29c5ad05861af620a7cc800187c7, ASSIGN}] 2023-03-28 05:54:14,320 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9dfa29c5ad05861af620a7cc800187c7, ASSIGN 2023-03-28 05:54:14,320 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ea176dc8596cbcf3c0937973953a326, ASSIGN 2023-03-28 05:54:14,321 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ea176dc8596cbcf3c0937973953a326, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:14,321 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9dfa29c5ad05861af620a7cc800187c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:14,328 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30e646cafaa19e2927fd54ee364189fa, ASSIGN 2023-03-28 05:54:14,329 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30e646cafaa19e2927fd54ee364189fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:14,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-28 05:54:14,474 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=30e646cafaa19e2927fd54ee364189fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,475 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=9dfa29c5ad05861af620a7cc800187c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,475 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679982854474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982854474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982854474"}]},"ts":"1679982854474"} 2023-03-28 05:54:14,474 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2ea176dc8596cbcf3c0937973953a326, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,475 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679982854474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982854474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982854474"}]},"ts":"1679982854474"} 2023-03-28 05:54:14,475 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679982854475"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982854475"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982854475"}]},"ts":"1679982854475"} 2023-03-28 05:54:14,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 30e646cafaa19e2927fd54ee364189fa, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:14,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 2ea176dc8596cbcf3c0937973953a326, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:14,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 9dfa29c5ad05861af620a7cc800187c7, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:14,531 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/.tmp/family1/a181bdb1501149bb935d3f830b4c948f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/a181bdb1501149bb935d3f830b4c948f 2023-03-28 05:54:14,538 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in afa94645be6bd970c21b5ea8be00e4e4/family1 of afa94645be6bd970c21b5ea8be00e4e4 into a181bdb1501149bb935d3f830b4c948f(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:14,538 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:54:14,538 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1679982853664; duration=0sec 2023-03-28 05:54:14,538 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:14,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/eef25634a19b42648148333dfb53ccd4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/2cb6961794444f09852cf8ff139414da, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_] to archive 2023-03-28 05:54:14,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:14,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/eef25634a19b42648148333dfb53ccd4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/eef25634a19b42648148333dfb53ccd4 2023-03-28 05:54:14,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/2cb6961794444f09852cf8ff139414da to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/2cb6961794444f09852cf8ff139414da 2023-03-28 05:54:14,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/family1/9a41a26a80ac411ebf50248ef1539078_SeqId_47_ 2023-03-28 05:54:14,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:14,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30e646cafaa19e2927fd54ee364189fa, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa.', STARTKEY => '1', ENDKEY => '2'} 2023-03-28 05:54:14,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:14,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,648 INFO [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,650 DEBUG [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa/family1 2023-03-28 05:54:14,650 DEBUG [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa/family1 2023-03-28 05:54:14,651 INFO [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30e646cafaa19e2927fd54ee364189fa columnFamilyName family1 2023-03-28 05:54:14,653 INFO [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] regionserver.HStore(310): Store=30e646cafaa19e2927fd54ee364189fa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:14,653 INFO [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,654 DEBUG [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa/family2 2023-03-28 05:54:14,655 DEBUG [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa/family2 2023-03-28 05:54:14,655 INFO [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30e646cafaa19e2927fd54ee364189fa columnFamilyName family2 2023-03-28 05:54:14,657 INFO [StoreOpener-30e646cafaa19e2927fd54ee364189fa-1] regionserver.HStore(310): Store=30e646cafaa19e2927fd54ee364189fa/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:14,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:54:14,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:54:14,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:14,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 30e646cafaa19e2927fd54ee364189fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60945360, jitterRate=-0.0918433666229248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:54:14,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 30e646cafaa19e2927fd54ee364189fa: 2023-03-28 05:54:14,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa., pid=31, masterSystemTime=1679982854629 2023-03-28 05:54:14,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:14,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:14,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:14,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9dfa29c5ad05861af620a7cc800187c7, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7.', STARTKEY => '2', ENDKEY => ''} 2023-03-28 05:54:14,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:14,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,670 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=30e646cafaa19e2927fd54ee364189fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679982854670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982854670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982854670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982854670"}]},"ts":"1679982854670"} 2023-03-28 05:54:14,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,676 INFO [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-03-28 05:54:14,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 30e646cafaa19e2927fd54ee364189fa, server=jenkins-hbase4.apache.org,39167,1679982818904 in 199 msec 2023-03-28 05:54:14,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=30e646cafaa19e2927fd54ee364189fa, ASSIGN in 361 msec 2023-03-28 05:54:14,684 DEBUG [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1 2023-03-28 05:54:14,684 DEBUG [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1 2023-03-28 05:54:14,684 INFO [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dfa29c5ad05861af620a7cc800187c7 columnFamilyName family1 2023-03-28 05:54:14,685 INFO [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] regionserver.HStore(310): Store=9dfa29c5ad05861af620a7cc800187c7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:14,686 INFO [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,688 DEBUG [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family2 2023-03-28 05:54:14,688 DEBUG [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family2 2023-03-28 05:54:14,689 INFO [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dfa29c5ad05861af620a7cc800187c7 columnFamilyName family2 2023-03-28 05:54:14,690 INFO [StoreOpener-9dfa29c5ad05861af620a7cc800187c7-1] regionserver.HStore(310): Store=9dfa29c5ad05861af620a7cc800187c7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:14,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:54:14,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:54:14,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:14,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9dfa29c5ad05861af620a7cc800187c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59284975, jitterRate=-0.11658503115177155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:54:14,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9dfa29c5ad05861af620a7cc800187c7: 2023-03-28 05:54:14,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7., pid=33, masterSystemTime=1679982854629 2023-03-28 05:54:14,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:14,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:14,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ea176dc8596cbcf3c0937973953a326, NAME => 'testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326.', STARTKEY => '', ENDKEY => '1'} 2023-03-28 05:54:14,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:14,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,712 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=9dfa29c5ad05861af620a7cc800187c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,713 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679982854712"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982854712"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982854712"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982854712"}]},"ts":"1679982854712"} 2023-03-28 05:54:14,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-03-28 05:54:14,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 9dfa29c5ad05861af620a7cc800187c7, server=jenkins-hbase4.apache.org,39167,1679982818904 in 234 msec 2023-03-28 05:54:14,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=9dfa29c5ad05861af620a7cc800187c7, ASSIGN in 398 msec 2023-03-28 05:54:14,723 INFO [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,733 DEBUG [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326/family1 2023-03-28 05:54:14,733 DEBUG [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326/family1 2023-03-28 05:54:14,734 INFO [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ea176dc8596cbcf3c0937973953a326 columnFamilyName family1 2023-03-28 05:54:14,735 INFO [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] regionserver.HStore(310): Store=2ea176dc8596cbcf3c0937973953a326/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:14,736 INFO [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,738 DEBUG [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326/family2 2023-03-28 05:54:14,738 DEBUG [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326/family2 2023-03-28 05:54:14,738 INFO [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ea176dc8596cbcf3c0937973953a326 columnFamilyName family2 2023-03-28 05:54:14,741 INFO [StoreOpener-2ea176dc8596cbcf3c0937973953a326-1] regionserver.HStore(310): Store=2ea176dc8596cbcf3c0937973953a326/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:14,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:54:14,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:54:14,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:14,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2ea176dc8596cbcf3c0937973953a326; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68579950, jitterRate=0.021920889616012573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:54:14,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2ea176dc8596cbcf3c0937973953a326: 2023-03-28 05:54:14,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326., pid=32, masterSystemTime=1679982854629 2023-03-28 05:54:14,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,789 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2ea176dc8596cbcf3c0937973953a326, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,789 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679982854789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982854789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982854789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982854789"}]},"ts":"1679982854789"} 2023-03-28 05:54:14,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-03-28 05:54:14,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 2ea176dc8596cbcf3c0937973953a326, server=jenkins-hbase4.apache.org,39167,1679982818904 in 313 msec 2023-03-28 05:54:14,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-03-28 05:54:14,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2ea176dc8596cbcf3c0937973953a326, ASSIGN in 475 msec 2023-03-28 05:54:14,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:54:14,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982854797"}]},"ts":"1679982854797"} 2023-03-28 05:54:14,799 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-28 05:54:14,802 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:54:14,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 954 msec 2023-03-28 05:54:14,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-28 05:54:14,959 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-28 05:54:14,968 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:14,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,971 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-28 05:54:14,971 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:14,971 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-28 05:54:14,971 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-28 05:54:14,971 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,971 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,977 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:14,978 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:14,978 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:14,978 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,979 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,979 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:14,979 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-28 05:54:14,979 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:14,979 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-28 05:54:14,980 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,980 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:54:14,980 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:14,980 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:14,980 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. started... 2023-03-28 05:54:14,980 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:14,980 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. started... 2023-03-28 05:54:14,981 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. started... 2023-03-28 05:54:14,992 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9dfa29c5ad05861af620a7cc800187c7 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-28 05:54:14,992 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 30e646cafaa19e2927fd54ee364189fa: 2023-03-28 05:54:14,992 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2ea176dc8596cbcf3c0937973953a326: 2023-03-28 05:54:14,992 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:14,992 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:14,992 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:54:15,004 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:54:15,062 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303280e272d6a1a9c41f6aed6935faebb95fe to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303280e272d6a1a9c41f6aed6935faebb95fe 2023-03-28 05:54:15,072 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/.tmp/family1/ed721c69fe264f81bb65110bbd670c7c 2023-03-28 05:54:15,096 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/.tmp/family1/ed721c69fe264f81bb65110bbd670c7c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/ed721c69fe264f81bb65110bbd670c7c 2023-03-28 05:54:15,103 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/ed721c69fe264f81bb65110bbd670c7c, entries=1, sequenceid=5, filesize=4.9 K 2023-03-28 05:54:15,105 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 9dfa29c5ad05861af620a7cc800187c7 in 113ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:15,105 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-28 05:54:15,106 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9dfa29c5ad05861af620a7cc800187c7: 2023-03-28 05:54:15,106 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:15,106 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:54:15,106 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:54:15,106 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,106 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-28 05:54:15,106 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-28 05:54:15,108 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,108 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:15,109 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,109 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:15,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-28 05:54:15,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37dd8d5b[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:15,111 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-28 05:54:15,111 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,113 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,113 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,113 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:15,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,116 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-28 05:54:15,116 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-28 05:54:15,116 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-28 05:54:15,118 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-28 05:54:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:15,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:15,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-28 05:54:15,122 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-28 05:54:15,122 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:15,122 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:15,122 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,122 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:15,126 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,126 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:15,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,126 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:15,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,127 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:15,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:15,130 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,135 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:15,136 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:15,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:15,136 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:15,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-28 05:54:15,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:15,136 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:15,136 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,136 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:15,136 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:15,136 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,137 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,137 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,137 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,137 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:15,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:15,237 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:15,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:15,242 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:15,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:15,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,257 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-28 05:54:15,257 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:15,257 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-28 05:54:15,257 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-28 05:54:15,257 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,257 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,259 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:15,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:15,259 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:15,259 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,260 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:15,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:15,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,261 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-28 05:54:15,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-28 05:54:15,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:15,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-28 05:54:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:54:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. started... 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. started... 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2ea176dc8596cbcf3c0937973953a326: 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:54:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:54:15,273 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. started... 2023-03-28 05:54:15,273 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 9dfa29c5ad05861af620a7cc800187c7 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-28 05:54:15,274 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 30e646cafaa19e2927fd54ee364189fa: 2023-03-28 05:54:15,274 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:54:15,274 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:54:15,309 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303286664b06703694759bc5ddde3b41f8f9e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303286664b06703694759bc5ddde3b41f8f9e 2023-03-28 05:54:15,718 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/.tmp/family1/dee8a162528c44a5a970599b2bc4077a 2023-03-28 05:54:15,725 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/.tmp/family1/dee8a162528c44a5a970599b2bc4077a as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/dee8a162528c44a5a970599b2bc4077a 2023-03-28 05:54:15,731 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/dee8a162528c44a5a970599b2bc4077a, entries=2, sequenceid=9, filesize=5.0 K 2023-03-28 05:54:15,736 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 9dfa29c5ad05861af620a7cc800187c7 in 463ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:15,737 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 9dfa29c5ad05861af620a7cc800187c7: 2023-03-28 05:54:15,737 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:54:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:54:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-28 05:54:15,737 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-28 05:54:15,740 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,740 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:15,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:15,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:15,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:15,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:15,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:15,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-28 05:54:15,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9868f19[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:15,743 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-28 05:54:15,743 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,744 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-28 05:54:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-28 05:54:15,745 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:15,745 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,745 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:15,746 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,746 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-28 05:54:15,746 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:15,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:15,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-28 05:54:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:15,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:15,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:15,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-28 05:54:15,750 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-28 05:54:15,750 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:15,750 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:15,750 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,750 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:15,752 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,752 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:15,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:15,753 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,753 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:15,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,755 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,758 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-28 05:54:15,758 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:15,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-28 05:54:15,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:15,759 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:15,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:15,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:15,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:15,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:15,758 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:15,759 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:15,762 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:15,862 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:15,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:15,871 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-28 05:54:15,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-28 05:54:15,875 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-28 05:54:15,880 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983455880 2023-03-28 05:54:15,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:15,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:15,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-28 05:54:15,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-28 05:54:15,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x243af323 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:15,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75e88507, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:15,893 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230328 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-28 05:54:16,790 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:16,790 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bd7fb37 to 127.0.0.1:58236 2023-03-28 05:54:16,790 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:16,791 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:16,791 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25f47b87 to 127.0.0.1:58236 2023-03-28 05:54:16,791 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:16,791 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:16,791 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d1a3218 to 127.0.0.1:58236 2023-03-28 05:54:16,792 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:16,794 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:16,794 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5045f8b2 to 127.0.0.1:58236 2023-03-28 05:54:16,794 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:16,800 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303285fd4315fee9c4eeaa625f12b6905a0fd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303285fd4315fee9c4eeaa625f12b6905a0fd 2023-03-28 05:54:16,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-28 05:54:16,897 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:16,898 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54520, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:16,918 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:16,922 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39398, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:16,946 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230328/family1/a3f7d31c31094ccbb56e1e91e34fa89b first=Optional[k0] last=Optional[k1] 2023-03-28 05:54:16,947 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230328/family1/a3f7d31c31094ccbb56e1e91e34fa89b}] 2023-03-28 05:54:16,953 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230328/family1/a3f7d31c31094ccbb56e1e91e34fa89b for inclusion in 9dfa29c5ad05861af620a7cc800187c7/family1 2023-03-28 05:54:16,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-28 05:54:16,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-28 05:54:16,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 9dfa29c5ad05861af620a7cc800187c7: 2023-03-28 05:54:16,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230328/family1/a3f7d31c31094ccbb56e1e91e34fa89b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testScannerOnBulkLoadRefHFiles__jn7qkhmptc0eicnt4ugaln1tsc3fna38mg8s1lqrv4lntpi96feuhbp4qfa0full/family1/a3f7d31c31094ccbb56e1e91e34fa89b 2023-03-28 05:54:16,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testScannerOnBulkLoadRefHFiles__jn7qkhmptc0eicnt4ugaln1tsc3fna38mg8s1lqrv4lntpi96feuhbp4qfa0full/family1/a3f7d31c31094ccbb56e1e91e34fa89b as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_ 2023-03-28 05:54:16,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testScannerOnBulkLoadRefHFiles__jn7qkhmptc0eicnt4ugaln1tsc3fna38mg8s1lqrv4lntpi96feuhbp4qfa0full/family1/a3f7d31c31094ccbb56e1e91e34fa89b into 9dfa29c5ad05861af620a7cc800187c7/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_ - updating store file list. 2023-03-28 05:54:16,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_ into 9dfa29c5ad05861af620a7cc800187c7/family1 2023-03-28 05:54:16,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testScannerOnBulkLoadRefHFiles__jn7qkhmptc0eicnt4ugaln1tsc3fna38mg8s1lqrv4lntpi96feuhbp4qfa0full/family1/a3f7d31c31094ccbb56e1e91e34fa89b into 9dfa29c5ad05861af620a7cc800187c7/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_) 2023-03-28 05:54:16,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testScannerOnBulkLoadRefHFiles__jn7qkhmptc0eicnt4ugaln1tsc3fna38mg8s1lqrv4lntpi96feuhbp4qfa0full/family1/a3f7d31c31094ccbb56e1e91e34fa89b 2023-03-28 05:54:16,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-28 05:54:16,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-28 05:54:16,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 9dfa29c5ad05861af620a7cc800187c7/family1 is initiating minor compaction (all files) 2023-03-28 05:54:16,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@304f0bcd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-28 05:54:16,980 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9dfa29c5ad05861af620a7cc800187c7/family1 in testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:54:16,980 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/ed721c69fe264f81bb65110bbd670c7c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/dee8a162528c44a5a970599b2bc4077a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/.tmp, totalSize=15.1 K 2023-03-28 05:54:16,981 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting ed721c69fe264f81bb65110bbd670c7c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982854959 2023-03-28 05:54:16,981 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting dee8a162528c44a5a970599b2bc4077a, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982854959 2023-03-28 05:54:16,982 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting c80045772bae490d9f946a5ece86028e_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982854959 2023-03-28 05:54:16,984 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-28 05:54:16,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:16,988 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303280e272d6a1a9c41f6aed6935faebb95fe to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303280e272d6a1a9c41f6aed6935faebb95fe 2023-03-28 05:54:16,991 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303286664b06703694759bc5ddde3b41f8f9e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303286664b06703694759bc5ddde3b41f8f9e 2023-03-28 05:54:16,991 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-28 05:54:16,991 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230328' 2023-03-28 05:54:16,992 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230328 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-28 05:54:16,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-28 05:54:16,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:16,993 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-28 05:54:16,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 1.1200 sec 2023-03-28 05:54:17,011 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9dfa29c5ad05861af620a7cc800187c7#family1#compaction#38 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:17,061 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259 (was 261), OpenFileDescriptor=591 (was 616), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=396 (was 378) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=4451 (was 4529) 2023-03-28 05:54:17,072 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/.tmp/family1/71ea9969ce704ae9a7e6a2457cc672af as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/71ea9969ce704ae9a7e6a2457cc672af 2023-03-28 05:54:17,080 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=396, ProcessCount=171, AvailableMemoryMB=4450 2023-03-28 05:54:17,081 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9dfa29c5ad05861af620a7cc800187c7/family1 of 9dfa29c5ad05861af620a7cc800187c7 into 71ea9969ce704ae9a7e6a2457cc672af(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:17,081 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9dfa29c5ad05861af620a7cc800187c7: 2023-03-28 05:54:17,081 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1679982856979; duration=0sec 2023-03-28 05:54:17,081 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:17,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-28 05:54:17,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,091 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:54:17,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-28 05:54:17,092 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:54:17,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-28 05:54:17,100 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,101 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024 empty. 2023-03-28 05:54:17,101 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,101 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-28 05:54:17,123 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:17,126 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7cca9ddfaf173442c42ea7f31de7f024, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:17,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:17,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 7cca9ddfaf173442c42ea7f31de7f024, disabling compactions & flushes 2023-03-28 05:54:17,133 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. after waiting 0 ms 2023-03-28 05:54:17,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,133 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,133 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:17,136 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:54:17,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679982857137"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982857137"}]},"ts":"1679982857137"} 2023-03-28 05:54:17,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:54:17,140 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:54:17,140 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982857140"}]},"ts":"1679982857140"} 2023-03-28 05:54:17,141 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-28 05:54:17,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7cca9ddfaf173442c42ea7f31de7f024, ASSIGN}] 2023-03-28 05:54:17,147 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7cca9ddfaf173442c42ea7f31de7f024, ASSIGN 2023-03-28 05:54:17,148 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7cca9ddfaf173442c42ea7f31de7f024, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:17,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/ed721c69fe264f81bb65110bbd670c7c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/dee8a162528c44a5a970599b2bc4077a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_] to archive 2023-03-28 05:54:17,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:17,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/ed721c69fe264f81bb65110bbd670c7c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/ed721c69fe264f81bb65110bbd670c7c 2023-03-28 05:54:17,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/dee8a162528c44a5a970599b2bc4077a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/dee8a162528c44a5a970599b2bc4077a 2023-03-28 05:54:17,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/family1/c80045772bae490d9f946a5ece86028e_SeqId_12_ 2023-03-28 05:54:17,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-28 05:54:17,299 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7cca9ddfaf173442c42ea7f31de7f024, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,299 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679982857299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982857299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982857299"}]},"ts":"1679982857299"} 2023-03-28 05:54:17,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 7cca9ddfaf173442c42ea7f31de7f024, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:17,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-28 05:54:17,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7cca9ddfaf173442c42ea7f31de7f024, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:17,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:17,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,460 INFO [StoreOpener-7cca9ddfaf173442c42ea7f31de7f024-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,461 DEBUG [StoreOpener-7cca9ddfaf173442c42ea7f31de7f024-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1 2023-03-28 05:54:17,461 DEBUG [StoreOpener-7cca9ddfaf173442c42ea7f31de7f024-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1 2023-03-28 05:54:17,462 INFO [StoreOpener-7cca9ddfaf173442c42ea7f31de7f024-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7cca9ddfaf173442c42ea7f31de7f024 columnFamilyName family1 2023-03-28 05:54:17,464 INFO [StoreOpener-7cca9ddfaf173442c42ea7f31de7f024-1] regionserver.HStore(310): Store=7cca9ddfaf173442c42ea7f31de7f024/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:17,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:54:17,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:17,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7cca9ddfaf173442c42ea7f31de7f024; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67634875, jitterRate=0.007838174700737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:17,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:17,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024., pid=37, masterSystemTime=1679982857453 2023-03-28 05:54:17,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7cca9ddfaf173442c42ea7f31de7f024, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,480 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679982857479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982857479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982857479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982857479"}]},"ts":"1679982857479"} 2023-03-28 05:54:17,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-28 05:54:17,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 7cca9ddfaf173442c42ea7f31de7f024, server=jenkins-hbase4.apache.org,39167,1679982818904 in 180 msec 2023-03-28 05:54:17,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-28 05:54:17,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7cca9ddfaf173442c42ea7f31de7f024, ASSIGN in 339 msec 2023-03-28 05:54:17,488 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:54:17,488 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982857488"}]},"ts":"1679982857488"} 2023-03-28 05:54:17,490 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-28 05:54:17,493 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:54:17,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 406 msec 2023-03-28 05:54:17,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-28 05:54:17,696 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-28 05:54:17,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:17,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,740 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:17,740 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:17,740 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:17,740 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:17,741 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,741 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,742 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,742 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:17,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:17,747 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,747 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:17,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:17,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,750 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:17,750 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:17,750 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:17,756 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:17,756 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:17,756 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,756 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:17,757 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-28 05:54:17,796 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130801834ec1fac499abba96a0ccb67ef3c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130801834ec1fac499abba96a0ccb67ef3c 2023-03-28 05:54:17,800 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/443d966000a14b13ab2ba72d85bc3cc2 2023-03-28 05:54:17,808 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/443d966000a14b13ab2ba72d85bc3cc2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/443d966000a14b13ab2ba72d85bc3cc2 2023-03-28 05:54:17,813 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/443d966000a14b13ab2ba72d85bc3cc2, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-28 05:54:17,814 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 57ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:17,815 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:17,815 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:17,815 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:17,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:17,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:17,816 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:17,817 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,817 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:17,818 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,818 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:17,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:17,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1061b0aa[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:17,820 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:17,821 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,822 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,822 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:17,822 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:17,822 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:17,822 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,822 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:17,825 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:17,825 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,825 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:17,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:17,825 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:17,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:17,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:17,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:17,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:17,828 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:17,828 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:17,828 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:17,828 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,828 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:17,831 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,831 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:17,831 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:17,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:17,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,832 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:17,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,833 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:17,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:17,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:17,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,836 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:17,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:17,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:17,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:17,836 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:17,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,837 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,837 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,837 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,837 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:17,837 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:17,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:17,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:17,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:17,937 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:17,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:17,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:17,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:17,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,947 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:17,947 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:17,947 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:17,947 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:17,947 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,947 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,949 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:17,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:17,949 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,949 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:17,949 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:17,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:17,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,950 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:17,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:17,950 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:17,950 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:17,950 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:17,952 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:17,952 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:17,952 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:17,952 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:17,952 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-28 05:54:18,366 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ed6f2911bbce41319eafbb4e1a30bd34 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128ed6f2911bbce41319eafbb4e1a30bd34 2023-03-28 05:54:18,774 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/402f47f250cf4885b60a91428b3b92a8 2023-03-28 05:54:18,780 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/402f47f250cf4885b60a91428b3b92a8 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/402f47f250cf4885b60a91428b3b92a8 2023-03-28 05:54:18,784 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/402f47f250cf4885b60a91428b3b92a8, entries=1, sequenceid=9, filesize=5.0 K 2023-03-28 05:54:18,785 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 833ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:18,785 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:18,785 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:18,785 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:18,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:18,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:18,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:18,787 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:18,788 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,788 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,788 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:18,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:18,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d92ac50[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:18,789 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:18,790 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,795 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,795 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:18,795 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:18,795 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:18,795 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,795 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:18,797 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:18,797 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,797 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:18,797 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:18,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:18,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:18,799 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:18,799 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:18,799 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:18,799 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,799 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:18,801 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,801 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:18,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,801 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:18,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,802 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:18,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:18,803 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:18,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,805 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:18,805 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:18,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:18,806 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:18,805 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:18,805 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:18,805 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,806 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,806 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:18,806 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,806 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:18,806 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:18,806 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,806 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:18,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:18,906 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:18,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:18,912 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:18,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:18,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,914 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:18,914 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:18,914 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:18,914 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:18,915 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,915 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,917 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,917 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:18,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:18,917 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:18,917 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:18,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:18,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,918 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,918 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:18,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:18,918 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:18,918 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:18,919 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:18,919 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:18,919 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:18,919 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:18,919 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:18,919 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:19,334 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201500513c8a3724926b03a5cbb49f63e74 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201500513c8a3724926b03a5cbb49f63e74 2023-03-28 05:54:19,741 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/b23ae17004074225ab899043a5a80e57 2023-03-28 05:54:19,747 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/b23ae17004074225ab899043a5a80e57 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/b23ae17004074225ab899043a5a80e57 2023-03-28 05:54:19,752 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/b23ae17004074225ab899043a5a80e57, entries=1, sequenceid=13, filesize=4.9 K 2023-03-28 05:54:19,753 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 834ms, sequenceid=13, compaction requested=true 2023-03-28 05:54:19,753 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:19,753 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:19,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:19,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:19,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:19,753 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:19,761 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@667e49ec[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:19,764 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:19,764 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,765 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,766 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:19,766 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,766 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:19,766 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:19,766 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:19,769 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,769 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:19,769 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:19,769 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:19,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:19,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:19,771 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:19,772 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:19,772 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:19,772 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,772 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:19,774 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,774 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,774 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:19,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:19,774 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:19,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,776 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:19,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,779 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:19,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:19,779 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:19,779 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:19,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,779 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:19,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:19,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:19,780 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:19,880 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:19,886 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:19,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:19,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,888 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:19,888 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:19,888 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:19,888 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:19,889 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,889 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,891 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:19,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:19,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:19,892 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,892 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,892 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:19,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:19,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,893 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,893 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:19,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:19,896 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:19,896 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:19,896 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:19,896 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:19,896 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:19,921 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c61eef249ce542d4bf455c13efca270a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c61eef249ce542d4bf455c13efca270a 2023-03-28 05:54:19,935 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/a22e4ee00661401a8146ed22961422bb 2023-03-28 05:54:19,942 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/a22e4ee00661401a8146ed22961422bb as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a22e4ee00661401a8146ed22961422bb 2023-03-28 05:54:19,947 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a22e4ee00661401a8146ed22961422bb, entries=1, sequenceid=17, filesize=4.9 K 2023-03-28 05:54:19,948 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 52ms, sequenceid=17, compaction requested=true 2023-03-28 05:54:19,948 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:19,948 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:19,948 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:19,948 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:19,949 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,949 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:19,949 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:19,950 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,950 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:19,951 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,951 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:19,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:19,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:19,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bbdfc7d[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:19,953 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:19,953 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,954 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,954 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:19,954 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:19,954 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,954 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:19,954 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:19,956 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,956 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:19,956 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:19,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:19,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:19,956 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:19,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:19,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:19,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:19,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:19,959 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:19,959 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:19,959 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:19,959 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,959 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:19,963 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,963 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,963 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:19,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:19,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:19,964 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:19,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,965 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:19,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:19,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:19,968 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:19,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:19,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,968 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:19,968 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:19,969 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:19,969 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:20,069 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:20,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:20,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:20,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:20,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,075 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:20,075 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:20,075 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:20,075 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:20,076 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,076 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,077 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:20,077 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:20,078 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,078 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:20,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,079 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:20,079 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:20,079 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:20,079 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:20,079 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:20,079 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:20,079 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:20,079 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:20,166 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:54:20,494 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228270ddd38acb54489b35297e22d891cb6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228270ddd38acb54489b35297e22d891cb6 2023-03-28 05:54:20,900 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/9198f74ccaf94746b195e7316a657a93 2023-03-28 05:54:20,905 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/9198f74ccaf94746b195e7316a657a93 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/9198f74ccaf94746b195e7316a657a93 2023-03-28 05:54:20,910 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/9198f74ccaf94746b195e7316a657a93, entries=1, sequenceid=21, filesize=4.9 K 2023-03-28 05:54:20,911 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 832ms, sequenceid=21, compaction requested=true 2023-03-28 05:54:20,911 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:20,911 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:20,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,921 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:20,921 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,922 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:20,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:20,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:20,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:20,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:20,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c4f340[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:20,923 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:20,923 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,924 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,924 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:20,925 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:20,925 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:20,925 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,925 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:20,926 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:20,926 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:20,926 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,926 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:20,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:20,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:20,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:20,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:20,929 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:20,929 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:20,929 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:20,929 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,929 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:20,930 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,930 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,930 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:20,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:20,931 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,936 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:20,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:20,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:20,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:20,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:20,936 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:20,937 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:20,937 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,037 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:21,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:21,042 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:21,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,044 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:21,044 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:21,044 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:21,044 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:21,044 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,044 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,045 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:21,045 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:21,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:21,046 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,046 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:21,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:21,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,047 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,047 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:21,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:21,047 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:21,047 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:21,047 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:21,048 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:21,461 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c8e84a0cb08043aaa88dd4541a72aefd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c8e84a0cb08043aaa88dd4541a72aefd 2023-03-28 05:54:21,870 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8 2023-03-28 05:54:21,876 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8 2023-03-28 05:54:21,883 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8, entries=1, sequenceid=25, filesize=4.9 K 2023-03-28 05:54:21,884 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 836ms, sequenceid=25, compaction requested=true 2023-03-28 05:54:21,884 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:21,884 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:21,884 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:21,886 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,886 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:21,887 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,887 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:21,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:21,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:21,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e9c37e4[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:21,889 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:21,889 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,891 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,891 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:21,895 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:21,895 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:21,898 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,898 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:21,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:21,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:21,901 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:21,901 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:21,901 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:21,901 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,901 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:21,902 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,903 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:21,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,903 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:21,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:21,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:21,904 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:21,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:21,910 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,920 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:21,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:21,920 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:21,920 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:21,921 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:21,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:21,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:21,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:22,021 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:22,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:22,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,041 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:22,041 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:22,041 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:22,041 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:22,043 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,044 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,045 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,045 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:22,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:22,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:22,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,047 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,047 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,047 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:22,060 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:22,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,061 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:22,061 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:22,061 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:22,072 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:22,072 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:22,073 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:22,073 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:22,073 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:22,110 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101bce305102f6046f8bbdf5315762fdba8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101bce305102f6046f8bbdf5315762fdba8 2023-03-28 05:54:22,132 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/e7506e9a169d452cbe5970e098f368b5 2023-03-28 05:54:22,141 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/e7506e9a169d452cbe5970e098f368b5 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/e7506e9a169d452cbe5970e098f368b5 2023-03-28 05:54:22,172 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/e7506e9a169d452cbe5970e098f368b5, entries=1, sequenceid=29, filesize=4.9 K 2023-03-28 05:54:22,174 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 101ms, sequenceid=29, compaction requested=true 2023-03-28 05:54:22,174 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:22,174 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:22,174 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:22,176 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,176 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,178 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,178 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:22,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:22,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a3922f2[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:22,178 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:22,178 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,181 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:22,181 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:22,182 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,182 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:22,183 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,184 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:22,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:22,187 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:22,187 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:22,187 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:22,187 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,187 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:22,191 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,191 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,191 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:22,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,191 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,193 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,201 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:22,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:22,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:22,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:22,202 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:22,202 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:22,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:22,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:22,303 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:22,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:22,309 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:22,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:22,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,312 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:22,312 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:22,312 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:22,312 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:22,313 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,313 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:22,314 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:22,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,315 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,315 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:22,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:22,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:22,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:22,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:22,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:22,316 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:22,316 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:22,316 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:22,316 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:22,331 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c992dccffa50473d97766276855e6a36 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c992dccffa50473d97766276855e6a36 2023-03-28 05:54:22,739 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/dd9e64b0b9ad45d7b043cdec357ee873 2023-03-28 05:54:22,744 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/dd9e64b0b9ad45d7b043cdec357ee873 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/dd9e64b0b9ad45d7b043cdec357ee873 2023-03-28 05:54:22,748 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/dd9e64b0b9ad45d7b043cdec357ee873, entries=1, sequenceid=33, filesize=4.9 K 2023-03-28 05:54:22,749 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 433ms, sequenceid=33, compaction requested=true 2023-03-28 05:54:22,749 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:22,749 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:22,749 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:22,749 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:22,749 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,749 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:22,749 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:22,752 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,752 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,752 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,752 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:22,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:22,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ed377dc[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:22,754 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:22,754 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,756 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,756 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:22,756 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,756 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:22,756 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:22,757 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:22,758 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,758 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:22,758 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:22,758 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:22,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:22,761 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:22,762 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:22,762 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:22,762 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,762 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:22,763 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,763 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,763 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:22,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:22,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:22,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,764 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,766 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,768 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:22,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:22,769 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:22,768 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:22,769 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:22,768 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,769 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,769 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,769 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:22,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:22,769 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:22,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:22,769 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:22,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:22,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:22,869 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:22,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:22,875 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:22,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:22,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,877 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:22,877 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:22,877 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:22,878 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:22,878 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,878 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,881 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:22,881 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:22,881 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,881 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:22,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:22,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,882 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,882 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:22,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,882 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:22,882 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:22,882 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:22,883 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:22,883 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:22,883 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:22,883 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:22,883 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:22,898 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ec3518f990fe49838c50197d22a7bdb2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907ec3518f990fe49838c50197d22a7bdb2 2023-03-28 05:54:22,904 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/cbc42102f87b43c8b658bddaeb2f9f83 2023-03-28 05:54:22,911 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/cbc42102f87b43c8b658bddaeb2f9f83 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/cbc42102f87b43c8b658bddaeb2f9f83 2023-03-28 05:54:22,917 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/cbc42102f87b43c8b658bddaeb2f9f83, entries=1, sequenceid=37, filesize=4.9 K 2023-03-28 05:54:22,918 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 35ms, sequenceid=37, compaction requested=true 2023-03-28 05:54:22,918 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:22,918 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:22,918 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:22,918 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:22,919 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,919 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:22,919 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:22,920 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,920 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,921 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,921 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:22,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:22,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f6cd3b5[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:22,923 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:22,923 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,924 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,924 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:22,924 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:22,924 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:22,924 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,924 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:22,926 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:22,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:22,929 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:22,929 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:22,929 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:22,929 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,929 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:22,932 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,932 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,932 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:22,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:22,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,933 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:22,936 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:22,936 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:22,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:22,936 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:22,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:23,037 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:23,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:23,043 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:23,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:23,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,045 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:23,045 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:23,045 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-28 05:54:23,045 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-28 05:54:23,045 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,045 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,046 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:23,047 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:23,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:23,047 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,047 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:23,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:23,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,048 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,048 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-28 05:54:23,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-28 05:54:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-28 05:54:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:23,048 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:23,049 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:23,049 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. started... 2023-03-28 05:54:23,049 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7cca9ddfaf173442c42ea7f31de7f024 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:23,463 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208d99cba50c3d43798b98afa30f7f4d88 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511208d99cba50c3d43798b98afa30f7f4d88 2023-03-28 05:54:23,878 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/2da985223af64775817bbebef16c38d6 2023-03-28 05:54:23,883 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/2da985223af64775817bbebef16c38d6 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/2da985223af64775817bbebef16c38d6 2023-03-28 05:54:23,888 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/2da985223af64775817bbebef16c38d6, entries=1, sequenceid=41, filesize=4.9 K 2023-03-28 05:54:23,889 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7cca9ddfaf173442c42ea7f31de7f024 in 840ms, sequenceid=41, compaction requested=true 2023-03-28 05:54:23,889 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:23,889 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:23,889 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,890 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-28 05:54:23,890 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-28 05:54:23,891 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,892 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:23,892 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,892 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:23,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:23,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:23,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-28 05:54:23,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20c0f2ab[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:23,895 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-28 05:54:23,895 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,896 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,897 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-28 05:54:23,897 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-28 05:54:23,897 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:23,897 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,897 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:23,898 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,898 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-28 05:54:23,898 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:23,899 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-28 05:54:23,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:23,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:23,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:23,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:23,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:54:23,902 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-28 05:54:23,902 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:23,902 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:23,902 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,902 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:23,905 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,905 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,905 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:23,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:23,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:23,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:23,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:23,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:23,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:23,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,907 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:23,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,912 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,912 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:23,912 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:23,912 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:23,913 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,913 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:23,913 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,913 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,913 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:23,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:23,913 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-28 05:54:23,913 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:23,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:23,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-28 05:54:23,913 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:23,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:23,913 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:23,914 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:24,014 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:24,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:24,016 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-28 05:54:24,018 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:24,019 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:24,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:24,025 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983464025 2023-03-28 05:54:24,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:24,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-28 05:54:24,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:24,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x2e60e869 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:24,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f91801f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:24,048 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:24,910 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010301332e3bed0d464bbcef217ca7620172 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010301332e3bed0d464bbcef217ca7620172 2023-03-28 05:54:24,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:24,944 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:24,946 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41912, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:24,965 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:24,967 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53674, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:25,000 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/87cadf5b0249481d9e04b66b0da1f0de first=Optional[r3] last=Optional[r6] 2023-03-28 05:54:25,001 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/87cadf5b0249481d9e04b66b0da1f0de}] 2023-03-28 05:54:25,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/87cadf5b0249481d9e04b66b0da1f0de for inclusion in 7cca9ddfaf173442c42ea7f31de7f024/family1 2023-03-28 05:54:25,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-28 05:54:25,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:25,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:25,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/87cadf5b0249481d9e04b66b0da1f0de to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8bp69vtad6lctcrk5aecofsdgbgbec5a4pvs4o5jmfol9hodpsav42kbjkglqduk/family1/87cadf5b0249481d9e04b66b0da1f0de 2023-03-28 05:54:25,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8bp69vtad6lctcrk5aecofsdgbgbec5a4pvs4o5jmfol9hodpsav42kbjkglqduk/family1/87cadf5b0249481d9e04b66b0da1f0de as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_ 2023-03-28 05:54:25,017 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8bp69vtad6lctcrk5aecofsdgbgbec5a4pvs4o5jmfol9hodpsav42kbjkglqduk/family1/87cadf5b0249481d9e04b66b0da1f0de into 7cca9ddfaf173442c42ea7f31de7f024/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_ - updating store file list. 2023-03-28 05:54:25,024 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_ into 7cca9ddfaf173442c42ea7f31de7f024/family1 2023-03-28 05:54:25,024 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8bp69vtad6lctcrk5aecofsdgbgbec5a4pvs4o5jmfol9hodpsav42kbjkglqduk/family1/87cadf5b0249481d9e04b66b0da1f0de into 7cca9ddfaf173442c42ea7f31de7f024/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_) 2023-03-28 05:54:25,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__8bp69vtad6lctcrk5aecofsdgbgbec5a4pvs4o5jmfol9hodpsav42kbjkglqduk/family1/87cadf5b0249481d9e04b66b0da1f0de 2023-03-28 05:54:25,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-28 05:54:25,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-28 05:54:25,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 7cca9ddfaf173442c42ea7f31de7f024/family1 is initiating minor compaction 2023-03-28 05:54:25,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c9a013b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:25,028 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7cca9ddfaf173442c42ea7f31de7f024/family1 in testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:25,028 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/402f47f250cf4885b60a91428b3b92a8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/b23ae17004074225ab899043a5a80e57, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a22e4ee00661401a8146ed22961422bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/9198f74ccaf94746b195e7316a657a93, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/e7506e9a169d452cbe5970e098f368b5, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/dd9e64b0b9ad45d7b043cdec357ee873, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/cbc42102f87b43c8b658bddaeb2f9f83, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/2da985223af64775817bbebef16c38d6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp, totalSize=50.0 K 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 402f47f250cf4885b60a91428b3b92a8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting b23ae17004074225ab899043a5a80e57, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a22e4ee00661401a8146ed22961422bb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 9198f74ccaf94746b195e7316a657a93, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 1ffa5bdba3b0418ea2c54c8d62acd0e8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting e7506e9a169d452cbe5970e098f368b5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting dd9e64b0b9ad45d7b043cdec357ee873, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting cbc42102f87b43c8b658bddaeb2f9f83, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 2da985223af64775817bbebef16c38d6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-28 05:54:25,029 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 7abad6f3e18e421e996b04fc35025c1a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-28 05:54:25,031 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:25,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:25,035 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228270ddd38acb54489b35297e22d891cb6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228270ddd38acb54489b35297e22d891cb6 2023-03-28 05:54:25,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c8e84a0cb08043aaa88dd4541a72aefd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c8e84a0cb08043aaa88dd4541a72aefd 2023-03-28 05:54:25,039 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101bce305102f6046f8bbdf5315762fdba8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101bce305102f6046f8bbdf5315762fdba8 2023-03-28 05:54:25,040 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c992dccffa50473d97766276855e6a36 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c992dccffa50473d97766276855e6a36 2023-03-28 05:54:25,040 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-28 05:54:25,040 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,100 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7cca9ddfaf173442c42ea7f31de7f024#family1#compaction#49 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:25,165 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/c0149c98959a4b8fa2e5e4ec4191f43d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/c0149c98959a4b8fa2e5e4ec4191f43d 2023-03-28 05:54:25,177 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7cca9ddfaf173442c42ea7f31de7f024/family1 of 7cca9ddfaf173442c42ea7f31de7f024 into c0149c98959a4b8fa2e5e4ec4191f43d(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:25,177 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:25,177 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679982865028; duration=0sec 2023-03-28 05:54:25,177 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:25,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/402f47f250cf4885b60a91428b3b92a8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/b23ae17004074225ab899043a5a80e57, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a22e4ee00661401a8146ed22961422bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/9198f74ccaf94746b195e7316a657a93, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/e7506e9a169d452cbe5970e098f368b5, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/dd9e64b0b9ad45d7b043cdec357ee873, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/cbc42102f87b43c8b658bddaeb2f9f83, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/2da985223af64775817bbebef16c38d6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_] to archive 2023-03-28 05:54:25,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:25,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/402f47f250cf4885b60a91428b3b92a8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/402f47f250cf4885b60a91428b3b92a8 2023-03-28 05:54:25,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/b23ae17004074225ab899043a5a80e57 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/b23ae17004074225ab899043a5a80e57 2023-03-28 05:54:25,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a22e4ee00661401a8146ed22961422bb to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a22e4ee00661401a8146ed22961422bb 2023-03-28 05:54:25,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/9198f74ccaf94746b195e7316a657a93 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/9198f74ccaf94746b195e7316a657a93 2023-03-28 05:54:25,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/1ffa5bdba3b0418ea2c54c8d62acd0e8 2023-03-28 05:54:25,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/e7506e9a169d452cbe5970e098f368b5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/e7506e9a169d452cbe5970e098f368b5 2023-03-28 05:54:25,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/dd9e64b0b9ad45d7b043cdec357ee873 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/dd9e64b0b9ad45d7b043cdec357ee873 2023-03-28 05:54:25,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/cbc42102f87b43c8b658bddaeb2f9f83 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/cbc42102f87b43c8b658bddaeb2f9f83 2023-03-28 05:54:25,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/2da985223af64775817bbebef16c38d6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/2da985223af64775817bbebef16c38d6 2023-03-28 05:54:25,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/7abad6f3e18e421e996b04fc35025c1a_SeqId_44_ 2023-03-28 05:54:25,597 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057eb41f68752f40279e9121eaed83bdb6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057eb41f68752f40279e9121eaed83bdb6 2023-03-28 05:54:25,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:25,666 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3bc66b33ad0547708c0986aabacdc791 first=Optional[r00] last=Optional[r2] 2023-03-28 05:54:25,667 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3bc66b33ad0547708c0986aabacdc791}] 2023-03-28 05:54:25,670 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3bc66b33ad0547708c0986aabacdc791 for inclusion in 7cca9ddfaf173442c42ea7f31de7f024/family1 2023-03-28 05:54:25,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-28 05:54:25,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:25,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:25,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3bc66b33ad0547708c0986aabacdc791 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qip9e5l706g56ccfl79im4j43aa2t6rp6u78vdfrbarspla1271ss99sjgr80si3/family1/3bc66b33ad0547708c0986aabacdc791 2023-03-28 05:54:25,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qip9e5l706g56ccfl79im4j43aa2t6rp6u78vdfrbarspla1271ss99sjgr80si3/family1/3bc66b33ad0547708c0986aabacdc791 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_ 2023-03-28 05:54:25,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qip9e5l706g56ccfl79im4j43aa2t6rp6u78vdfrbarspla1271ss99sjgr80si3/family1/3bc66b33ad0547708c0986aabacdc791 into 7cca9ddfaf173442c42ea7f31de7f024/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_ - updating store file list. 2023-03-28 05:54:25,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_ into 7cca9ddfaf173442c42ea7f31de7f024/family1 2023-03-28 05:54:25,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qip9e5l706g56ccfl79im4j43aa2t6rp6u78vdfrbarspla1271ss99sjgr80si3/family1/3bc66b33ad0547708c0986aabacdc791 into 7cca9ddfaf173442c42ea7f31de7f024/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_) 2023-03-28 05:54:25,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__qip9e5l706g56ccfl79im4j43aa2t6rp6u78vdfrbarspla1271ss99sjgr80si3/family1/3bc66b33ad0547708c0986aabacdc791 2023-03-28 05:54:25,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-28 05:54:25,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-28 05:54:25,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 7cca9ddfaf173442c42ea7f31de7f024/family1 is initiating minor compaction (all files) 2023-03-28 05:54:25,708 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7cca9ddfaf173442c42ea7f31de7f024/family1 in testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:54:25,709 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/443d966000a14b13ab2ba72d85bc3cc2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/c0149c98959a4b8fa2e5e4ec4191f43d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp, totalSize=337.0 K 2023-03-28 05:54:25,709 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 443d966000a14b13ab2ba72d85bc3cc2, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843296 2023-03-28 05:54:25,710 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting c0149c98959a4b8fa2e5e4ec4191f43d, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243296 2023-03-28 05:54:25,710 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878843296 2023-03-28 05:54:25,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@756d30f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:25,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:25,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:25,720 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130801834ec1fac499abba96a0ccb67ef3c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130801834ec1fac499abba96a0ccb67ef3c 2023-03-28 05:54:25,725 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201500513c8a3724926b03a5cbb49f63e74 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201500513c8a3724926b03a5cbb49f63e74 2023-03-28 05:54:25,732 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c61eef249ce542d4bf455c13efca270a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c61eef249ce542d4bf455c13efca270a 2023-03-28 05:54:25,732 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-28 05:54:25,732 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-28 05:54:25,733 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-28 05:54:25,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-28 05:54:25,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:25,741 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:54:25,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.7240 sec 2023-03-28 05:54:25,752 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7cca9ddfaf173442c42ea7f31de7f024#family1#compaction#50 average throughput is 5.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:25,878 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=264 (was 258) - Thread LEAK? -, OpenFileDescriptor=623 (was 592) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=421 (was 396) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=4377 (was 4450) 2023-03-28 05:54:25,895 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=263, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=421, ProcessCount=171, AvailableMemoryMB=4376 2023-03-28 05:54:25,897 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-28 05:54:25,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:25,900 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:54:25,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-28 05:54:25,901 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:54:25,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-28 05:54:25,903 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:25,904 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 empty. 2023-03-28 05:54:25,905 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:25,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-28 05:54:26,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-28 05:54:26,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-28 05:54:26,328 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:26,329 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e7794a565488ca38a96110be8fabfe9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:26,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:26,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 5e7794a565488ca38a96110be8fabfe9, disabling compactions & flushes 2023-03-28 05:54:26,336 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:26,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:26,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. after waiting 0 ms 2023-03-28 05:54:26,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:26,336 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:26,336 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:26,339 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:54:26,340 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982866340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982866340"}]},"ts":"1679982866340"} 2023-03-28 05:54:26,341 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:54:26,343 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:54:26,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982866343"}]},"ts":"1679982866343"} 2023-03-28 05:54:26,344 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-28 05:54:26,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, ASSIGN}] 2023-03-28 05:54:26,350 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, ASSIGN 2023-03-28 05:54:26,352 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:26,503 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:26,503 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982866503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982866503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982866503"}]},"ts":"1679982866503"} 2023-03-28 05:54:26,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:26,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-28 05:54:26,628 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/.tmp/family1/b7459e72ff3645f88e51c7167a043029 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/b7459e72ff3645f88e51c7167a043029 2023-03-28 05:54:26,634 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7cca9ddfaf173442c42ea7f31de7f024/family1 of 7cca9ddfaf173442c42ea7f31de7f024 into b7459e72ff3645f88e51c7167a043029(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:26,634 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:54:26,634 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1679982865708; duration=0sec 2023-03-28 05:54:26,634 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:26,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:26,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e7794a565488ca38a96110be8fabfe9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:26,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:26,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:26,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:26,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:26,666 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:26,667 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:26,667 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:26,668 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e7794a565488ca38a96110be8fabfe9 columnFamilyName family1 2023-03-28 05:54:26,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/443d966000a14b13ab2ba72d85bc3cc2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/c0149c98959a4b8fa2e5e4ec4191f43d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_] to archive 2023-03-28 05:54:26,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:26,670 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(310): Store=5e7794a565488ca38a96110be8fabfe9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:26,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:26,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:26,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/443d966000a14b13ab2ba72d85bc3cc2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/443d966000a14b13ab2ba72d85bc3cc2 2023-03-28 05:54:26,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/c0149c98959a4b8fa2e5e4ec4191f43d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/c0149c98959a4b8fa2e5e4ec4191f43d 2023-03-28 05:54:26,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:26,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/family1/a2f6cef47ffe4b1f9edffce4ea60e853_SeqId_47_ 2023-03-28 05:54:26,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:26,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e7794a565488ca38a96110be8fabfe9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71051954, jitterRate=0.058756619691848755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:26,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:26,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., pid=41, masterSystemTime=1679982866661 2023-03-28 05:54:26,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:26,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:26,683 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:26,683 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982866683"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982866683"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982866683"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982866683"}]},"ts":"1679982866683"} 2023-03-28 05:54:26,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-28 05:54:26,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904 in 181 msec 2023-03-28 05:54:26,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-28 05:54:26,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, ASSIGN in 341 msec 2023-03-28 05:54:26,690 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:54:26,691 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982866691"}]},"ts":"1679982866691"} 2023-03-28 05:54:26,692 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-28 05:54:26,695 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:54:26,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 798 msec 2023-03-28 05:54:27,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-28 05:54:27,008 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-28 05:54:27,041 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:27,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,053 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:27,054 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:27,054 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:27,054 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:27,054 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,054 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,056 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:27,056 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:27,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:27,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,058 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,058 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:27,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:27,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,059 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,060 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:27,060 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:27,060 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:27,064 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:27,064 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:27,064 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:27,064 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:27,065 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-28 05:54:27,524 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300d260aa3ff3f4759a65a8af0d8422068 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300d260aa3ff3f4759a65a8af0d8422068 2023-03-28 05:54:27,529 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/911048a41ea54735a088793b768340ca 2023-03-28 05:54:27,536 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/911048a41ea54735a088793b768340ca as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/911048a41ea54735a088793b768340ca 2023-03-28 05:54:27,542 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/911048a41ea54735a088793b768340ca, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-28 05:54:27,543 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 478ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:27,543 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:27,543 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:27,544 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:27,544 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:27,546 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13dd6af3[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:27,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:27,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,549 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,550 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:27,550 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:27,550 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:27,550 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,550 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:27,552 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:27,552 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:27,552 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,552 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:27,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:27,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:27,555 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:27,555 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:27,555 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:27,555 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,555 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:27,557 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,557 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:27,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,557 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:27,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:27,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:27,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,559 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,561 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,561 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,561 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:27,561 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:27,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:27,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:27,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:27,561 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:27,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:27,562 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:27,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,562 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:27,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:27,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,562 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,662 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:27,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:27,667 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:27,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:27,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,671 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:27,671 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:27,671 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:27,671 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:27,671 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,671 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,673 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,673 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:27,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:27,673 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:27,673 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:27,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:27,674 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:27,674 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:27,675 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-28 05:54:28,112 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112837d11f53dbe242d8a5b2e3fda9f08c0c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112837d11f53dbe242d8a5b2e3fda9f08c0c 2023-03-28 05:54:28,124 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/a469f3131328493e89c8be1acdabc91a 2023-03-28 05:54:28,136 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/a469f3131328493e89c8be1acdabc91a as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/a469f3131328493e89c8be1acdabc91a 2023-03-28 05:54:28,144 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/a469f3131328493e89c8be1acdabc91a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-28 05:54:28,145 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 470ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:28,145 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:28,145 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:28,145 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:28,147 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,147 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,148 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,148 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:28,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@466592c3[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:28,150 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:28,150 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,151 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:28,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:28,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:28,152 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,152 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:28,153 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:28,153 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:28,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:28,158 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:28,158 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:28,158 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:28,159 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,159 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:28,161 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,161 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:28,161 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:28,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:28,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,162 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,164 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:28,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,171 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:28,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:28,171 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:28,171 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:28,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,172 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,172 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:28,172 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:28,172 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:28,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:28,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-28 05:54:28,272 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:28,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:28,278 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:28,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:28,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,287 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:28,287 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:28,287 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:28,287 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:28,288 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,288 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,289 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:28,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:28,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:28,289 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,293 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,293 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:28,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:28,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:28,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:28,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:28,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:28,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:28,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:28,304 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:28,304 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:28,304 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:28,340 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d9a0b374fe0e4947b0825c254d8c1119 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d9a0b374fe0e4947b0825c254d8c1119 2023-03-28 05:54:28,753 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/bfb43c05c99b47e8ba38be966b40be6c 2023-03-28 05:54:28,758 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/bfb43c05c99b47e8ba38be966b40be6c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/bfb43c05c99b47e8ba38be966b40be6c 2023-03-28 05:54:28,762 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/bfb43c05c99b47e8ba38be966b40be6c, entries=1, sequenceid=13, filesize=5.0 K 2023-03-28 05:54:28,763 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 459ms, sequenceid=13, compaction requested=true 2023-03-28 05:54:28,763 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:28,763 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:28,763 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:28,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:28,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:28,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:28,766 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,766 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,767 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,767 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:28,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:28,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f5d00c1[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:28,769 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:28,769 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,770 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,770 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:28,770 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:28,770 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:28,770 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,770 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:28,772 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:28,772 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,772 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,772 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:28,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:28,774 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:28,774 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:28,774 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:28,774 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,774 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:28,776 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,776 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:28,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,776 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,777 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,779 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:28,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:28,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,782 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:28,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:28,782 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:28,783 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:28,783 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:28,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:28,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:28,883 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:28,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:28,888 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:28,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:28,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,891 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:28,891 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:28,891 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:28,891 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:28,891 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,891 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,893 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,893 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:28,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:28,893 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,893 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,894 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,894 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:28,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,894 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:28,894 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:28,894 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:28,895 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:28,895 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:28,895 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:28,895 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:28,895 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:28,920 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120555d25afc312a400981d923891b8768b9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120555d25afc312a400981d923891b8768b9 2023-03-28 05:54:28,926 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/af050ee98dff457aaf9567c4d14c30b5 2023-03-28 05:54:28,931 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/af050ee98dff457aaf9567c4d14c30b5 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/af050ee98dff457aaf9567c4d14c30b5 2023-03-28 05:54:28,941 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/af050ee98dff457aaf9567c4d14c30b5, entries=1, sequenceid=17, filesize=5.0 K 2023-03-28 05:54:28,942 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 47ms, sequenceid=17, compaction requested=true 2023-03-28 05:54:28,942 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:28,942 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:28,943 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:28,944 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,944 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,945 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,945 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:28,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@282ffe2b[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:28,947 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:28,947 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,962 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,962 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:28,962 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,963 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:28,962 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:28,963 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:28,965 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:28,965 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:28,968 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:28,969 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:28,969 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:28,969 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,969 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:28,970 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,970 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,970 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:28,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:28,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:28,971 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,972 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:28,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:28,975 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:28,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:28,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:28,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:28,976 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:28,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-28 05:54:28,976 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:28,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:29,076 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:29,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:29,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:29,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:29,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,083 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:29,083 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:29,083 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:29,083 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:29,083 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,083 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,085 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:29,085 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:29,085 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,085 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,086 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,086 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:29,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:29,087 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:29,087 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:29,087 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:29,505 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b25740580d764a3a93367cdd5fece848 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228b25740580d764a3a93367cdd5fece848 2023-03-28 05:54:29,512 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/6de98854a8b44bfca52c0dbf820c5e13 2023-03-28 05:54:29,517 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/6de98854a8b44bfca52c0dbf820c5e13 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/6de98854a8b44bfca52c0dbf820c5e13 2023-03-28 05:54:29,522 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/6de98854a8b44bfca52c0dbf820c5e13, entries=1, sequenceid=21, filesize=5.0 K 2023-03-28 05:54:29,522 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 435ms, sequenceid=21, compaction requested=true 2023-03-28 05:54:29,522 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:29,522 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:29,525 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,525 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:29,525 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,526 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:29,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:29,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@505d832f[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:29,527 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:29,527 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,531 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,531 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:29,531 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,531 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:29,531 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:29,531 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:29,532 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,532 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:29,533 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:29,533 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:29,535 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:29,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:29,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:29,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,535 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:29,538 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,538 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,538 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:29,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:29,538 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,542 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:29,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:29,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:29,545 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:29,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:29,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:29,646 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:29,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:29,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:29,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:29,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,652 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:29,653 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:29,653 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:29,653 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:29,653 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,653 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,654 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:29,654 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:29,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:29,655 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:29,655 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:29,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,656 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:29,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:29,656 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:29,656 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:29,656 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:29,657 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:30,075 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123115e1b172819c452c810e7d2aeb901a55 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123115e1b172819c452c810e7d2aeb901a55 2023-03-28 05:54:30,090 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/73ab6e47e8514c27bad5e97c28083bb1 2023-03-28 05:54:30,096 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/73ab6e47e8514c27bad5e97c28083bb1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/73ab6e47e8514c27bad5e97c28083bb1 2023-03-28 05:54:30,102 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/73ab6e47e8514c27bad5e97c28083bb1, entries=1, sequenceid=25, filesize=5.0 K 2023-03-28 05:54:30,102 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 445ms, sequenceid=25, compaction requested=true 2023-03-28 05:54:30,103 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:30,103 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:30,103 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:30,103 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:30,103 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,103 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:30,103 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:30,105 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,105 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,107 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,107 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:30,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a44e06d[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:30,108 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:30,108 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,110 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,110 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:30,110 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:30,110 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:30,110 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,110 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:30,111 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,111 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:30,111 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,112 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:30,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:30,114 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:30,114 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:30,114 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:30,114 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,114 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:30,117 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,118 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:30,118 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,119 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,121 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,125 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,125 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,125 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,125 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:30,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:30,126 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:30,125 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:30,125 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,126 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,126 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,126 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,126 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:30,126 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:30,126 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:30,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-28 05:54:30,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:30,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:30,226 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:30,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:30,232 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:30,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:30,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,235 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:30,235 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:30,235 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:30,235 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:30,236 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,236 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,237 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,237 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:30,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:30,238 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,238 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,239 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,239 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:30,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:30,239 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:30,240 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:30,240 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:30,240 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:30,240 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:30,240 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:30,278 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016049c96d6c7d4967b38727e6400c5cec to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601016049c96d6c7d4967b38727e6400c5cec 2023-03-28 05:54:30,287 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/29b9255db59947299945a45aaa669702 2023-03-28 05:54:30,295 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/29b9255db59947299945a45aaa669702 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/29b9255db59947299945a45aaa669702 2023-03-28 05:54:30,302 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/29b9255db59947299945a45aaa669702, entries=1, sequenceid=29, filesize=5.0 K 2023-03-28 05:54:30,303 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 63ms, sequenceid=29, compaction requested=true 2023-03-28 05:54:30,303 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:30,303 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:30,303 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:30,303 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:30,303 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,303 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:30,303 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:30,305 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,305 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,306 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,306 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:30,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:30,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5df8b4ec[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:30,308 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:30,308 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,311 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,311 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:30,311 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:30,311 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:30,311 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,311 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:30,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:30,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:30,314 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:30,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:30,317 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:30,317 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:30,317 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:30,317 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,317 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:30,319 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,319 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:30,319 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:30,320 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,321 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,328 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:30,328 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:30,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:30,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:30,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:30,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:30,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,329 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,329 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:30,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:30,330 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:30,330 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:30,430 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:30,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:30,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:30,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:30,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,437 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:30,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:30,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:30,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:30,438 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,438 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,439 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:30,439 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:30,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:30,439 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,439 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:30,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:30,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,440 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,441 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:30,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:30,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:30,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:30,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:30,441 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:30,441 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:30,441 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:30,441 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:30,457 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036171a04ddf5c4badaf926a16e2eff30c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036171a04ddf5c4badaf926a16e2eff30c 2023-03-28 05:54:30,462 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/0c9e31c772044516bdebd0ac912434b6 2023-03-28 05:54:30,467 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/0c9e31c772044516bdebd0ac912434b6 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0c9e31c772044516bdebd0ac912434b6 2023-03-28 05:54:30,471 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0c9e31c772044516bdebd0ac912434b6, entries=1, sequenceid=33, filesize=5.0 K 2023-03-28 05:54:30,472 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 31ms, sequenceid=33, compaction requested=true 2023-03-28 05:54:30,472 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:30,472 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:30,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,474 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,474 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,474 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:30,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:30,476 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:30,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a71d7de[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:30,476 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,477 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,477 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:30,478 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:30,478 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:30,478 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,478 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:30,480 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,480 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:30,480 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,480 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:30,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:30,483 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:30,483 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:30,483 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:30,483 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,483 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:30,484 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,484 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:30,484 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:30,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:30,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:30,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:30,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:30,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,485 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,487 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:30,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:30,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:30,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-28 05:54:30,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:30,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:30,490 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:30,489 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:30,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,490 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:30,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:30,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:30,490 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,590 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:30,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:30,596 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:30,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:30,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,598 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:30,598 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:30,598 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:30,598 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:30,599 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,599 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,601 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:30,601 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:30,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:30,601 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:30,601 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:30,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:30,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,603 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,603 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:30,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:30,603 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:30,603 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:30,603 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:30,604 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:30,604 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:30,604 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:30,604 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:30,604 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:31,020 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090751f6482b633c40e38c6a0df44d95c6d3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015090751f6482b633c40e38c6a0df44d95c6d3 2023-03-28 05:54:31,426 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/1f5added028346da975b730408461317 2023-03-28 05:54:31,431 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/1f5added028346da975b730408461317 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/1f5added028346da975b730408461317 2023-03-28 05:54:31,435 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/1f5added028346da975b730408461317, entries=1, sequenceid=37, filesize=5.0 K 2023-03-28 05:54:31,436 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 832ms, sequenceid=37, compaction requested=true 2023-03-28 05:54:31,436 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:31,436 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:31,436 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:31,438 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,438 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:31,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:31,439 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,439 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:31,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:31,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:31,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:31,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:31,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36097944[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:31,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:31,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,444 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:31,444 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,444 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:31,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:31,444 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:31,445 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:31,445 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:31,445 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,445 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:31,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:31,448 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:31,448 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:31,448 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:31,448 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,448 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:31,449 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,449 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,450 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:31,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:31,450 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:31,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,451 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:31,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,453 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:31,453 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:31,453 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:31,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-28 05:54:31,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:31,454 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:31,454 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,454 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,554 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:31,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:31,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:31,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:31,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,560 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:31,560 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:31,560 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-28 05:54:31,560 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-28 05:54:31,561 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,561 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,565 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,565 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:31,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:31,565 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:31,565 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:31,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,566 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,566 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-28 05:54:31,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-28 05:54:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-28 05:54:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:31,566 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:31,566 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. started... 2023-03-28 05:54:31,566 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e7794a565488ca38a96110be8fabfe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:31,977 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206979074374b44e76a782a79fa62aff4d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511206979074374b44e76a782a79fa62aff4d 2023-03-28 05:54:32,197 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:54:32,382 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/55785d4b095d42aaa6008ba020ea9a4c 2023-03-28 05:54:32,387 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/55785d4b095d42aaa6008ba020ea9a4c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/55785d4b095d42aaa6008ba020ea9a4c 2023-03-28 05:54:32,391 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/55785d4b095d42aaa6008ba020ea9a4c, entries=1, sequenceid=41, filesize=5.0 K 2023-03-28 05:54:32,392 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e7794a565488ca38a96110be8fabfe9 in 826ms, sequenceid=41, compaction requested=true 2023-03-28 05:54:32,392 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:32,392 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-28 05:54:32,392 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-28 05:54:32,394 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,394 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:32,394 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,394 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:32,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:32,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-28 05:54:32,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b53a060[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:32,396 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-28 05:54:32,396 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,397 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-28 05:54:32,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-28 05:54:32,397 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:32,397 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,397 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-28 05:54:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:32,399 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,399 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-28 05:54:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-28 05:54:32,401 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-28 05:54:32,402 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:32,402 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:32,402 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,402 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:32,404 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,404 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:32,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,404 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:32,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,406 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-28 05:54:32,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,408 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:32,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:32,409 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:32,409 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:32,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:32,509 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:32,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:32,511 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:32,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:32,513 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:32,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:32,514 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983472514 2023-03-28 05:54:32,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:32,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-28 05:54:32,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:32,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x572ecbef to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:32,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44ac386d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:32,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,355 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103394e631f738b4a20a41cfa007e462865 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103394e631f738b4a20a41cfa007e462865 2023-03-28 05:54:33,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:33,368 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:33,369 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41934, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:33,375 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:33,376 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:33,384 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38dd5a119d604c15842f7480ae5779f4 first=Optional[r3] last=Optional[r6] 2023-03-28 05:54:33,384 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38dd5a119d604c15842f7480ae5779f4}] 2023-03-28 05:54:33,388 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38dd5a119d604c15842f7480ae5779f4 for inclusion in 5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:33,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-28 05:54:33,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:33,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:33,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38dd5a119d604c15842f7480ae5779f4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1lg6sd8cahksceg4d8ub7odams34nua32dkcvf8k0u1ijrm1n8ftrg89j6jhjs1t/family1/38dd5a119d604c15842f7480ae5779f4 2023-03-28 05:54:33,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1lg6sd8cahksceg4d8ub7odams34nua32dkcvf8k0u1ijrm1n8ftrg89j6jhjs1t/family1/38dd5a119d604c15842f7480ae5779f4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_ 2023-03-28 05:54:33,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1lg6sd8cahksceg4d8ub7odams34nua32dkcvf8k0u1ijrm1n8ftrg89j6jhjs1t/family1/38dd5a119d604c15842f7480ae5779f4 into 5e7794a565488ca38a96110be8fabfe9/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_ - updating store file list. 2023-03-28 05:54:33,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_ into 5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:33,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1lg6sd8cahksceg4d8ub7odams34nua32dkcvf8k0u1ijrm1n8ftrg89j6jhjs1t/family1/38dd5a119d604c15842f7480ae5779f4 into 5e7794a565488ca38a96110be8fabfe9/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_) 2023-03-28 05:54:33,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1lg6sd8cahksceg4d8ub7odams34nua32dkcvf8k0u1ijrm1n8ftrg89j6jhjs1t/family1/38dd5a119d604c15842f7480ae5779f4 2023-03-28 05:54:33,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-28 05:54:33,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-28 05:54:33,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 5e7794a565488ca38a96110be8fabfe9/family1 is initiating minor compaction 2023-03-28 05:54:33,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@39cf22e4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:33,402 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5e7794a565488ca38a96110be8fabfe9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:33,402 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/a469f3131328493e89c8be1acdabc91a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/bfb43c05c99b47e8ba38be966b40be6c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/af050ee98dff457aaf9567c4d14c30b5, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/6de98854a8b44bfca52c0dbf820c5e13, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/73ab6e47e8514c27bad5e97c28083bb1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/29b9255db59947299945a45aaa669702, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0c9e31c772044516bdebd0ac912434b6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/1f5added028346da975b730408461317, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/55785d4b095d42aaa6008ba020ea9a4c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp, totalSize=50.4 K 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a469f3131328493e89c8be1acdabc91a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting bfb43c05c99b47e8ba38be966b40be6c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting af050ee98dff457aaf9567c4d14c30b5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 6de98854a8b44bfca52c0dbf820c5e13, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 73ab6e47e8514c27bad5e97c28083bb1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 29b9255db59947299945a45aaa669702, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 0c9e31c772044516bdebd0ac912434b6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 1f5added028346da975b730408461317, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 55785d4b095d42aaa6008ba020ea9a4c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-28 05:54:33,402 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-28 05:54:33,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:33,404 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:33,405 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228b25740580d764a3a93367cdd5fece848 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228b25740580d764a3a93367cdd5fece848 2023-03-28 05:54:33,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123115e1b172819c452c810e7d2aeb901a55 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123115e1b172819c452c810e7d2aeb901a55 2023-03-28 05:54:33,407 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601016049c96d6c7d4967b38727e6400c5cec to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601016049c96d6c7d4967b38727e6400c5cec 2023-03-28 05:54:33,409 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036171a04ddf5c4badaf926a16e2eff30c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036171a04ddf5c4badaf926a16e2eff30c 2023-03-28 05:54:33,409 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-28 05:54:33,409 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-28 05:54:33,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:33,424 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5e7794a565488ca38a96110be8fabfe9#family1#compaction#61 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:34,242 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/0fe3008894f64874a18e4f2de349a2fd as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0fe3008894f64874a18e4f2de349a2fd 2023-03-28 05:54:34,247 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5e7794a565488ca38a96110be8fabfe9/family1 of 5e7794a565488ca38a96110be8fabfe9 into 0fe3008894f64874a18e4f2de349a2fd(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:34,247 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:34,247 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679982873401; duration=0sec 2023-03-28 05:54:34,247 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120549152a949e1b481fb55367c87b2405c3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120549152a949e1b481fb55367c87b2405c3 2023-03-28 05:54:34,247 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:34,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:34,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/a469f3131328493e89c8be1acdabc91a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/bfb43c05c99b47e8ba38be966b40be6c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/af050ee98dff457aaf9567c4d14c30b5, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/6de98854a8b44bfca52c0dbf820c5e13, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/73ab6e47e8514c27bad5e97c28083bb1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/29b9255db59947299945a45aaa669702, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0c9e31c772044516bdebd0ac912434b6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/1f5added028346da975b730408461317, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/55785d4b095d42aaa6008ba020ea9a4c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_] to archive 2023-03-28 05:54:34,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:34,270 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e33909e27feb4a44a976914fb615c0c8 first=Optional[r00] last=Optional[r2] 2023-03-28 05:54:34,271 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e33909e27feb4a44a976914fb615c0c8}] 2023-03-28 05:54:34,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/a469f3131328493e89c8be1acdabc91a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/a469f3131328493e89c8be1acdabc91a 2023-03-28 05:54:34,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e33909e27feb4a44a976914fb615c0c8 for inclusion in 5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:34,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/bfb43c05c99b47e8ba38be966b40be6c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/bfb43c05c99b47e8ba38be966b40be6c 2023-03-28 05:54:34,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/af050ee98dff457aaf9567c4d14c30b5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/af050ee98dff457aaf9567c4d14c30b5 2023-03-28 05:54:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-28 05:54:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:34,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/6de98854a8b44bfca52c0dbf820c5e13 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/6de98854a8b44bfca52c0dbf820c5e13 2023-03-28 05:54:34,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e33909e27feb4a44a976914fb615c0c8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__snsg0nr49g4ic11pmvshdoj04e3d1il8gll4hup4l5rissth6cst3fujuifqqlch/family1/e33909e27feb4a44a976914fb615c0c8 2023-03-28 05:54:34,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/73ab6e47e8514c27bad5e97c28083bb1 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/73ab6e47e8514c27bad5e97c28083bb1 2023-03-28 05:54:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__snsg0nr49g4ic11pmvshdoj04e3d1il8gll4hup4l5rissth6cst3fujuifqqlch/family1/e33909e27feb4a44a976914fb615c0c8 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_ 2023-03-28 05:54:34,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/29b9255db59947299945a45aaa669702 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/29b9255db59947299945a45aaa669702 2023-03-28 05:54:34,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__snsg0nr49g4ic11pmvshdoj04e3d1il8gll4hup4l5rissth6cst3fujuifqqlch/family1/e33909e27feb4a44a976914fb615c0c8 into 5e7794a565488ca38a96110be8fabfe9/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_ - updating store file list. 2023-03-28 05:54:34,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0c9e31c772044516bdebd0ac912434b6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0c9e31c772044516bdebd0ac912434b6 2023-03-28 05:54:34,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/1f5added028346da975b730408461317 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/1f5added028346da975b730408461317 2023-03-28 05:54:34,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/55785d4b095d42aaa6008ba020ea9a4c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/55785d4b095d42aaa6008ba020ea9a4c 2023-03-28 05:54:34,284 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_ into 5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:34,284 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__snsg0nr49g4ic11pmvshdoj04e3d1il8gll4hup4l5rissth6cst3fujuifqqlch/family1/e33909e27feb4a44a976914fb615c0c8 into 5e7794a565488ca38a96110be8fabfe9/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_) 2023-03-28 05:54:34,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__snsg0nr49g4ic11pmvshdoj04e3d1il8gll4hup4l5rissth6cst3fujuifqqlch/family1/e33909e27feb4a44a976914fb615c0c8 2023-03-28 05:54:34,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-28 05:54:34,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/5537a90e5c0a41f0a922d235a705e3d8_SeqId_44_ 2023-03-28 05:54:34,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-28 05:54:34,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 5e7794a565488ca38a96110be8fabfe9/family1 is initiating minor compaction (all files) 2023-03-28 05:54:34,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@43e1427; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:34,285 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5e7794a565488ca38a96110be8fabfe9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:34,286 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/911048a41ea54735a088793b768340ca, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0fe3008894f64874a18e4f2de349a2fd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp, totalSize=390.1 K 2023-03-28 05:54:34,286 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 911048a41ea54735a088793b768340ca, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843296 2023-03-28 05:54:34,286 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 0fe3008894f64874a18e4f2de349a2fd, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243296 2023-03-28 05:54:34,287 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878843296 2023-03-28 05:54:34,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:34,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:34,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300d260aa3ff3f4759a65a8af0d8422068 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511300d260aa3ff3f4759a65a8af0d8422068 2023-03-28 05:54:34,292 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d9a0b374fe0e4947b0825c254d8c1119 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201d9a0b374fe0e4947b0825c254d8c1119 2023-03-28 05:54:34,293 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120555d25afc312a400981d923891b8768b9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120555d25afc312a400981d923891b8768b9 2023-03-28 05:54:34,293 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-28 05:54:34,293 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-28 05:54:34,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:34,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:34,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:34,295 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:34,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.7830 sec 2023-03-28 05:54:34,302 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5e7794a565488ca38a96110be8fabfe9#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:34,370 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-28 05:54:34,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:34,780 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-28 05:54:34,781 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:34,781 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-28 05:54:34,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-28 05:54:34,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE}] 2023-03-28 05:54:34,785 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE 2023-03-28 05:54:34,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:34,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982874786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982874786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982874786"}]},"ts":"1679982874786"} 2023-03-28 05:54:34,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:34,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:34,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e7794a565488ca38a96110be8fabfe9, disabling compactions & flushes 2023-03-28 05:54:34,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,519 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/.tmp/family1/0ca007bccdb7482bbb1a20743c48f8d2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0ca007bccdb7482bbb1a20743c48f8d2 2023-03-28 05:54:35,523 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5e7794a565488ca38a96110be8fabfe9/family1 of 5e7794a565488ca38a96110be8fabfe9 into 0ca007bccdb7482bbb1a20743c48f8d2(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:54:35,523 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:35,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,523 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1679982874285; duration=1sec 2023-03-28 05:54:35,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. after waiting 0 ms 2023-03-28 05:54:35,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,523 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:35,523 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/911048a41ea54735a088793b768340ca, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0fe3008894f64874a18e4f2de349a2fd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_] to archive 2023-03-28 05:54:35,524 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:35,525 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/911048a41ea54735a088793b768340ca to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/911048a41ea54735a088793b768340ca 2023-03-28 05:54:35,526 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0fe3008894f64874a18e4f2de349a2fd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0fe3008894f64874a18e4f2de349a2fd 2023-03-28 05:54:35,527 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/3ef1d0de23b44fc689f6eb3c655d7536_SeqId_47_ 2023-03-28 05:54:35,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-28 05:54:35,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:35,532 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 5e7794a565488ca38a96110be8fabfe9 to self. 2023-03-28 05:54:35,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,534 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=CLOSED 2023-03-28 05:54:35,534 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982875534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982875534"}]},"ts":"1679982875534"} 2023-03-28 05:54:35,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-28 05:54:35,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904 in 748 msec 2023-03-28 05:54:35,537 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=true 2023-03-28 05:54:35,687 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:35,687 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982875687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982875687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982875687"}]},"ts":"1679982875687"} 2023-03-28 05:54:35,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:35,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e7794a565488ca38a96110be8fabfe9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:35,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:35,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,845 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,846 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:35,846 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:35,846 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e7794a565488ca38a96110be8fabfe9 columnFamilyName family1 2023-03-28 05:54:35,851 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0ca007bccdb7482bbb1a20743c48f8d2 2023-03-28 05:54:35,851 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(310): Store=5e7794a565488ca38a96110be8fabfe9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:35,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:35,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e7794a565488ca38a96110be8fabfe9; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68189163, jitterRate=0.01609770953655243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:35,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:35,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., pid=47, masterSystemTime=1679982875841 2023-03-28 05:54:35,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:35,859 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:35,859 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982875859"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982875859"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982875859"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982875859"}]},"ts":"1679982875859"} 2023-03-28 05:54:35,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-28 05:54:35,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904 in 172 msec 2023-03-28 05:54:35,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-28 05:54:35,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE in 1.0770 sec 2023-03-28 05:54:35,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-28 05:54:35,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0820 sec 2023-03-28 05:54:35,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4960 sec 2023-03-28 05:54:35,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-28 05:54:35,869 INFO [Listener at localhost/33463] compactions.TestMobCompactor(278): alter status finished 2023-03-28 05:54:35,870 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:35,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:35,872 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:35,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:35,873 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983475873 2023-03-28 05:54:35,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:35,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-28 05:54:35,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:35,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x3ee9f8a5 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:35,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b23d045, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:35,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:35,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:35,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:35,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:35,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:36,706 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128613761b191fd4df292658bd668d5e06d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128613761b191fd4df292658bd668d5e06d 2023-03-28 05:54:36,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:36,719 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:36,720 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41940, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:36,726 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:36,727 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:36,736 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4baece11c01e4663a403618ca00b681c first=Optional[r05] last=Optional[r8] 2023-03-28 05:54:36,737 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=51 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4baece11c01e4663a403618ca00b681c}] 2023-03-28 05:54:36,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4baece11c01e4663a403618ca00b681c for inclusion in 5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:36,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-28 05:54:36,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4baece11c01e4663a403618ca00b681c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gbatke9876uj9opf2c06bitfcklho02ca47ch3lj5n3rhi6bj8bobo7b4vv0076f/family1/4baece11c01e4663a403618ca00b681c 2023-03-28 05:54:36,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gbatke9876uj9opf2c06bitfcklho02ca47ch3lj5n3rhi6bj8bobo7b4vv0076f/family1/4baece11c01e4663a403618ca00b681c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/10ffb0a19e6245c78689ada2ee595546_SeqId_53_ 2023-03-28 05:54:36,749 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gbatke9876uj9opf2c06bitfcklho02ca47ch3lj5n3rhi6bj8bobo7b4vv0076f/family1/4baece11c01e4663a403618ca00b681c into 5e7794a565488ca38a96110be8fabfe9/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/10ffb0a19e6245c78689ada2ee595546_SeqId_53_ - updating store file list. 2023-03-28 05:54:36,752 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/10ffb0a19e6245c78689ada2ee595546_SeqId_53_ into 5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:36,752 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gbatke9876uj9opf2c06bitfcklho02ca47ch3lj5n3rhi6bj8bobo7b4vv0076f/family1/4baece11c01e4663a403618ca00b681c into 5e7794a565488ca38a96110be8fabfe9/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/10ffb0a19e6245c78689ada2ee595546_SeqId_53_) 2023-03-28 05:54:36,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gbatke9876uj9opf2c06bitfcklho02ca47ch3lj5n3rhi6bj8bobo7b4vv0076f/family1/4baece11c01e4663a403618ca00b681c 2023-03-28 05:54:36,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:36,755 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:36,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511206979074374b44e76a782a79fa62aff4d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511206979074374b44e76a782a79fa62aff4d 2023-03-28 05:54:36,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112837d11f53dbe242d8a5b2e3fda9f08c0c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112837d11f53dbe242d8a5b2e3fda9f08c0c 2023-03-28 05:54:36,758 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-28 05:54:36,758 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-28 05:54:36,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:36,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:36,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:36,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:36,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:36,760 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:36,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 889 msec 2023-03-28 05:54:36,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-28 05:54:36,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:37,216 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-28 05:54:37,217 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-28 05:54:37,217 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-28 05:54:37,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-28 05:54:37,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE}] 2023-03-28 05:54:37,224 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE 2023-03-28 05:54:37,224 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:37,225 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982877224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982877224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982877224"}]},"ts":"1679982877224"} 2023-03-28 05:54:37,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:37,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e7794a565488ca38a96110be8fabfe9, disabling compactions & flushes 2023-03-28 05:54:37,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. after waiting 0 ms 2023-03-28 05:54:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:37,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-28 05:54:37,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:37,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:37,383 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 5e7794a565488ca38a96110be8fabfe9 to self. 2023-03-28 05:54:37,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,384 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=CLOSED 2023-03-28 05:54:37,385 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982877384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982877384"}]},"ts":"1679982877384"} 2023-03-28 05:54:37,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-28 05:54:37,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904 in 160 msec 2023-03-28 05:54:37,388 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=true 2023-03-28 05:54:37,538 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:37,538 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982877538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982877538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982877538"}]},"ts":"1679982877538"} 2023-03-28 05:54:37,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:37,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:37,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e7794a565488ca38a96110be8fabfe9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:37,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:37,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,696 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,697 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:37,697 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1 2023-03-28 05:54:37,697 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e7794a565488ca38a96110be8fabfe9 columnFamilyName family1 2023-03-28 05:54:37,702 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/0ca007bccdb7482bbb1a20743c48f8d2 2023-03-28 05:54:37,705 DEBUG [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/family1/10ffb0a19e6245c78689ada2ee595546_SeqId_53_ 2023-03-28 05:54:37,705 INFO [StoreOpener-5e7794a565488ca38a96110be8fabfe9-1] regionserver.HStore(310): Store=5e7794a565488ca38a96110be8fabfe9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:37,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:54:37,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e7794a565488ca38a96110be8fabfe9; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70699684, jitterRate=0.05350738763809204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:37,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:54:37,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9., pid=53, masterSystemTime=1679982877691 2023-03-28 05:54:37,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:37,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:54:37,714 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5e7794a565488ca38a96110be8fabfe9, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:37,714 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679982877714"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982877714"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982877714"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982877714"}]},"ts":"1679982877714"} 2023-03-28 05:54:37,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-28 05:54:37,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 5e7794a565488ca38a96110be8fabfe9, server=jenkins-hbase4.apache.org,39167,1679982818904 in 175 msec 2023-03-28 05:54:37,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-28 05:54:37,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5e7794a565488ca38a96110be8fabfe9, REOPEN/MOVE in 493 msec 2023-03-28 05:54:37,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-28 05:54:37,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 499 msec 2023-03-28 05:54:37,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 916 msec 2023-03-28 05:54:37,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-28 05:54:37,724 INFO [Listener at localhost/33463] compactions.TestMobCompactor(278): alter status finished 2023-03-28 05:54:37,724 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-28 05:54:37,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:37,726 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:37,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:37,727 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983477727 2023-03-28 05:54:37,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:37,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-28 05:54:37,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:37,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x0c7d445e to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:37,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9d90c6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-28 05:54:37,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-28 05:54:37,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:37,735 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-28 05:54:37,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-03-28 05:54:37,785 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=257 (was 263), OpenFileDescriptor=647 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=386 (was 421), ProcessCount=171 (was 171), AvailableMemoryMB=4355 (was 4376) 2023-03-28 05:54:37,798 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=257, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=386, ProcessCount=171, AvailableMemoryMB=4355 2023-03-28 05:54:37,800 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-28 05:54:37,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:37,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:54:37,802 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-28 05:54:37,803 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:54:37,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-28 05:54:37,804 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:37,805 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 empty. 2023-03-28 05:54:37,805 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:37,805 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-28 05:54:37,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-28 05:54:38,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-28 05:54:38,213 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:38,215 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 059a3217a2809735664619b21d588755, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:38,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-28 05:54:38,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:38,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 059a3217a2809735664619b21d588755, disabling compactions & flushes 2023-03-28 05:54:38,621 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:38,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:38,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. after waiting 0 ms 2023-03-28 05:54:38,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:38,621 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:38,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:38,623 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:54:38,624 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982878624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982878624"}]},"ts":"1679982878624"} 2023-03-28 05:54:38,625 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:54:38,626 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:54:38,626 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982878626"}]},"ts":"1679982878626"} 2023-03-28 05:54:38,627 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-28 05:54:38,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, ASSIGN}] 2023-03-28 05:54:38,631 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, ASSIGN 2023-03-28 05:54:38,632 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:38,782 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:38,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982878782"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982878782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982878782"}]},"ts":"1679982878782"} 2023-03-28 05:54:38,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:38,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-28 05:54:38,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:38,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 059a3217a2809735664619b21d588755, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:38,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 059a3217a2809735664619b21d588755 2023-03-28 05:54:38,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:38,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 059a3217a2809735664619b21d588755 2023-03-28 05:54:38,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 059a3217a2809735664619b21d588755 2023-03-28 05:54:38,940 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 059a3217a2809735664619b21d588755 2023-03-28 05:54:38,941 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:38,941 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:38,941 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 059a3217a2809735664619b21d588755 columnFamilyName family1 2023-03-28 05:54:38,943 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(310): Store=059a3217a2809735664619b21d588755/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:38,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:38,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 059a3217a2809735664619b21d588755 2023-03-28 05:54:38,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:38,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 059a3217a2809735664619b21d588755; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59690959, jitterRate=-0.1105353981256485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:38,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:38,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., pid=57, masterSystemTime=1679982878936 2023-03-28 05:54:38,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:38,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:38,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:38,951 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982878950"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982878950"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982878950"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982878950"}]},"ts":"1679982878950"} 2023-03-28 05:54:38,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-28 05:54:38,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904 in 168 msec 2023-03-28 05:54:38,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-28 05:54:38,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, ASSIGN in 324 msec 2023-03-28 05:54:38,955 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:54:38,956 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982878955"}]},"ts":"1679982878955"} 2023-03-28 05:54:38,957 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-28 05:54:38,961 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:54:38,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1610 sec 2023-03-28 05:54:39,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-28 05:54:39,908 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-28 05:54:39,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:39,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,931 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:39,931 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:39,931 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:39,931 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:39,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,933 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:39,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:39,933 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:39,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,934 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:39,934 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:39,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:39,939 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:39,939 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:39,939 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:39,939 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:39,939 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:39,940 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:39,940 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:39,940 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-28 05:54:40,368 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306f6e960afc774310a680c8b163a6c1ab to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306f6e960afc774310a680c8b163a6c1ab 2023-03-28 05:54:40,561 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-28 05:54:40,773 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/723f3ba3b5e94cb68ffe3765b6a16593 2023-03-28 05:54:40,779 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/723f3ba3b5e94cb68ffe3765b6a16593 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/723f3ba3b5e94cb68ffe3765b6a16593 2023-03-28 05:54:40,782 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/723f3ba3b5e94cb68ffe3765b6a16593, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-28 05:54:40,783 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 843ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:40,783 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:40,784 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:40,784 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:40,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,786 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:40,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:40,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:40,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:40,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:40,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33143e32[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:40,787 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:40,788 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,789 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:40,789 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,789 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:40,790 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:40,792 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:40,792 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:40,792 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:40,792 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,792 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:40,795 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,795 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:40,795 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:40,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:40,796 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,797 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:40,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:40,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:40,799 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:40,800 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:40,799 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:40,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:40,800 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,900 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:40,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:40,905 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:40,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:40,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,906 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:40,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:40,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:40,906 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:40,907 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,907 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,911 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,911 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:40,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:40,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:40,911 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:40,911 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:40,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:40,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,912 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:40,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:40,912 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:40,912 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:40,912 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:40,913 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:40,913 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:40,913 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:40,913 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:40,913 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-28 05:54:41,033 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:54:41,326 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285a9cb81598ff421981b0de26b107fdbc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285a9cb81598ff421981b0de26b107fdbc 2023-03-28 05:54:41,731 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/ee54296186384cd6908c26a41008a1d2 2023-03-28 05:54:41,736 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/ee54296186384cd6908c26a41008a1d2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/ee54296186384cd6908c26a41008a1d2 2023-03-28 05:54:41,740 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/ee54296186384cd6908c26a41008a1d2, entries=1, sequenceid=9, filesize=5.0 K 2023-03-28 05:54:41,740 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 827ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:41,740 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:41,740 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:41,740 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:41,740 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:41,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:41,741 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:41,742 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,742 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:41,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:41,742 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,742 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:41,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:41,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37dfc0a9[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:41,744 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:41,744 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,746 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,746 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:41,746 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:41,746 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:41,746 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,746 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:41,747 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:41,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:41,747 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:41,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:41,749 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:41,749 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:41,749 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:41,749 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,749 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:41,751 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,751 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:41,751 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:41,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:41,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:41,751 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,752 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,754 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,754 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,754 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:41,754 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:41,754 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-28 05:54:41,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:41,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:41,754 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:41,755 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:41,754 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:41,754 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,755 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,755 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:41,755 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:41,755 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:41,755 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:41,855 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:41,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:41,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:41,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:41,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,861 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:41,861 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:41,861 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:41,861 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:41,862 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,862 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,864 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,864 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:41,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:41,865 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:41,865 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:41,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,866 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:41,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:41,866 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:41,866 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:41,866 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:41,866 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:41,880 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201115501093f2e45c2b94d357f6c3dd03d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201115501093f2e45c2b94d357f6c3dd03d 2023-03-28 05:54:42,285 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/9d302bf3abc340c09314b4dee5e6e988 2023-03-28 05:54:42,290 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/9d302bf3abc340c09314b4dee5e6e988 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/9d302bf3abc340c09314b4dee5e6e988 2023-03-28 05:54:42,295 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/9d302bf3abc340c09314b4dee5e6e988, entries=1, sequenceid=13, filesize=5.0 K 2023-03-28 05:54:42,296 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 430ms, sequenceid=13, compaction requested=true 2023-03-28 05:54:42,296 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:42,296 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:42,299 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:42,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:42,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:42,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:42,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:42,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ae14c4f[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:42,301 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:42,301 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,302 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:42,302 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,303 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:42,304 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:42,306 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:42,307 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:42,307 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:42,307 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,307 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:42,308 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,308 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:42,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,308 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,309 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:42,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:42,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:42,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:42,310 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,313 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,313 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:42,313 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:42,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:42,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:42,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,313 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:42,414 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:42,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:42,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:42,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:42,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,420 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:42,420 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:42,420 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:42,420 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:42,420 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,420 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,422 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:42,422 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:42,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:42,422 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,422 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,423 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,423 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:42,424 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,424 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:42,424 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:42,424 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:42,424 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:42,424 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:42,424 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:42,424 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:42,424 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:42,836 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053eb84dde80534297b0197e2d9cdaa007 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053eb84dde80534297b0197e2d9cdaa007 2023-03-28 05:54:42,841 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/d35367837cc244fd94db892fc353ec60 2023-03-28 05:54:42,846 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/d35367837cc244fd94db892fc353ec60 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/d35367837cc244fd94db892fc353ec60 2023-03-28 05:54:42,850 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/d35367837cc244fd94db892fc353ec60, entries=1, sequenceid=17, filesize=5.0 K 2023-03-28 05:54:42,851 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 427ms, sequenceid=17, compaction requested=true 2023-03-28 05:54:42,851 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:42,851 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:42,851 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:42,852 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,853 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:42,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:42,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:42,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c87b5d3[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:42,854 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:42,854 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,857 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,857 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:42,857 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:42,857 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:42,857 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,857 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:42,861 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:42,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:42,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:42,861 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:42,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:42,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:42,863 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:42,863 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:42,863 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:42,863 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,864 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:42,865 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,865 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,865 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:42,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:42,866 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,867 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,870 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:42,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-28 05:54:42,870 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:42,870 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:42,871 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:42,870 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:42,871 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:42,971 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:42,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:42,975 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:42,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:42,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,977 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:42,977 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:42,977 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:42,977 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:42,978 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,978 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,979 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:42,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:42,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:42,979 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:42,979 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:42,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,980 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,980 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:42,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:42,980 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:42,980 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:42,980 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:42,980 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:42,981 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:42,981 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:42,981 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:42,981 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:43,394 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280c36c11b11cf4428b4eb71854f9df9cd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512280c36c11b11cf4428b4eb71854f9df9cd 2023-03-28 05:54:43,800 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/6e00d5b05bf44d5886e55489f42d83cd 2023-03-28 05:54:43,806 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/6e00d5b05bf44d5886e55489f42d83cd as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/6e00d5b05bf44d5886e55489f42d83cd 2023-03-28 05:54:43,810 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/6e00d5b05bf44d5886e55489f42d83cd, entries=1, sequenceid=21, filesize=5.0 K 2023-03-28 05:54:43,811 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 830ms, sequenceid=21, compaction requested=true 2023-03-28 05:54:43,811 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:43,811 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:43,811 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:43,811 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:43,811 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,811 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:43,811 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:43,814 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,814 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:43,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,815 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:43,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:43,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e70f1df[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:43,817 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:43,817 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,818 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,818 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:43,818 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:43,818 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:43,819 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,819 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:43,820 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:43,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:43,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:43,823 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:43,823 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:43,823 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:43,823 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,823 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:43,825 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,825 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,825 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:43,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,826 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:43,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:43,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:43,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:43,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,827 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:43,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:43,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:43,835 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:43,835 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:43,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:43,835 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,836 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:43,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:43,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:43,836 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,936 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:43,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:43,941 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:43,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:43,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,943 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:43,943 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:43,943 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:43,943 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:43,944 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,944 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,945 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:43,945 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:43,946 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:43,946 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,947 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,947 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:43,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:43,947 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:43,947 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:43,947 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:43,948 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:43,948 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:43,948 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:43,948 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:43,948 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:44,369 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123128fbda6104ac402a8a5abbd8941b5969 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123128fbda6104ac402a8a5abbd8941b5969 2023-03-28 05:54:44,375 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/17506566d6784629b0c3b38d11405a2e 2023-03-28 05:54:44,396 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/17506566d6784629b0c3b38d11405a2e as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/17506566d6784629b0c3b38d11405a2e 2023-03-28 05:54:44,402 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/17506566d6784629b0c3b38d11405a2e, entries=1, sequenceid=25, filesize=5.0 K 2023-03-28 05:54:44,404 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 456ms, sequenceid=25, compaction requested=true 2023-03-28 05:54:44,404 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:44,404 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:44,406 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,406 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:44,407 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,407 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:44,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:44,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27e3ae30[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:44,410 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:44,410 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,413 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,414 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,414 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:44,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,420 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:44,420 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:44,420 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:44,421 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:44,422 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:44,422 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:44,421 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:44,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:44,427 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:44,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:44,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:44,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,428 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:44,430 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,430 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:44,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,431 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:44,431 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,433 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,440 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:44,440 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:44,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:44,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:44,440 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:44,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-28 05:54:44,448 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:44,448 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,448 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:44,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:44,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:44,549 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:44,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:44,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:44,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:44,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,556 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:44,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:44,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:44,556 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:44,557 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,557 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,558 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:44,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:44,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:44,558 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:44,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:44,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:44,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:44,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:44,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:44,560 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:44,560 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:44,560 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:44,560 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:44,580 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018cef78442c864ef18ee7c346b51b3ae7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601018cef78442c864ef18ee7c346b51b3ae7 2023-03-28 05:54:44,990 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/04de76b432b4435694749a8a2b6350b5 2023-03-28 05:54:45,006 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/04de76b432b4435694749a8a2b6350b5 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/04de76b432b4435694749a8a2b6350b5 2023-03-28 05:54:45,013 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/04de76b432b4435694749a8a2b6350b5, entries=1, sequenceid=29, filesize=5.0 K 2023-03-28 05:54:45,014 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 454ms, sequenceid=29, compaction requested=true 2023-03-28 05:54:45,014 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:45,014 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:45,014 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:45,014 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:45,014 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,014 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:45,014 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:45,017 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,017 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:45,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:45,017 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,017 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:45,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:45,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67201db7[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:45,020 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:45,020 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,021 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:45,021 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,022 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:45,024 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:45,024 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:45,024 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,024 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:45,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:45,027 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:45,027 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:45,027 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:45,027 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,027 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:45,029 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,029 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,029 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:45,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:45,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,030 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,032 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,035 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,035 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:45,035 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,035 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:45,036 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:45,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:45,036 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:45,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:45,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:45,036 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,036 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,036 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,036 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,036 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:45,036 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:45,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:45,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:45,137 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:45,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:45,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:45,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:45,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,143 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:45,144 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:45,144 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:45,144 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:45,144 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,144 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,146 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,146 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,146 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:45,146 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:45,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:45,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:45,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,148 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:45,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,148 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:45,148 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:45,148 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:45,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:45,152 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:45,152 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:45,152 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:45,152 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:45,177 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103dd70670889ce49c4bf4e6a4755814071 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103dd70670889ce49c4bf4e6a4755814071 2023-03-28 05:54:45,586 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/8349414c6bc84568bd8665714d592111 2023-03-28 05:54:45,591 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/8349414c6bc84568bd8665714d592111 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/8349414c6bc84568bd8665714d592111 2023-03-28 05:54:45,597 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/8349414c6bc84568bd8665714d592111, entries=1, sequenceid=33, filesize=5.0 K 2023-03-28 05:54:45,598 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 446ms, sequenceid=33, compaction requested=true 2023-03-28 05:54:45,598 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:45,598 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:45,598 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:45,601 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,601 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:45,601 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,601 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:45,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:45,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@264815ad[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:45,603 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:45,603 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,604 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,604 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:45,605 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:45,605 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:45,605 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,605 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:45,606 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:45,606 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:45,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:45,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:45,610 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:45,610 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:45,610 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:45,610 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,610 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:45,612 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,612 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:45,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,612 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:45,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:45,612 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:45,614 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,617 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,617 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:45,617 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:45,617 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:45,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:45,618 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:45,617 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:45,617 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,618 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,618 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,618 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,618 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:45,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:45,618 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:45,618 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-28 05:54:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:45,718 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:45,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:45,723 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:45,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:45,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,725 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:45,725 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:45,725 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:45,725 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:45,726 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,726 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,727 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:45,727 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:45,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:45,727 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:45,728 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,729 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:45,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:45,729 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:45,729 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:45,729 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:45,729 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:45,746 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079e56916bce6e4c948cda63c57988e35a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509079e56916bce6e4c948cda63c57988e35a 2023-03-28 05:54:46,157 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/a30520f830c14ad0bbf00d7e3807307a 2023-03-28 05:54:46,163 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/a30520f830c14ad0bbf00d7e3807307a as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/a30520f830c14ad0bbf00d7e3807307a 2023-03-28 05:54:46,168 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/a30520f830c14ad0bbf00d7e3807307a, entries=1, sequenceid=37, filesize=5.0 K 2023-03-28 05:54:46,168 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 439ms, sequenceid=37, compaction requested=true 2023-03-28 05:54:46,169 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:46,169 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:46,169 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:46,169 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:46,169 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,169 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:46,169 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:46,171 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,171 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:46,171 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,171 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:46,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:46,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f5fe6b2[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:46,173 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:46,173 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,175 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:46,175 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:46,176 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,176 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:46,177 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:46,177 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,177 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:46,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:46,177 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:46,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:46,181 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:46,181 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:46,181 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:46,181 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,181 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:46,182 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,182 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,182 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:46,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:46,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:46,183 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,184 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:46,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,187 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:46,187 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:46,187 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:46,187 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:46,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:46,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:46,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-28 05:54:46,288 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:46,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:46,293 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:46,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:46,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,295 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:46,295 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:46,295 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-28 05:54:46,295 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-28 05:54:46,296 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,296 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,298 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:46,298 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:46,299 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,299 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,300 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-28 05:54:46,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-28 05:54:46,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:46,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-28 05:54:46,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:54:46,301 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:46,337 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:46,337 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. started... 2023-03-28 05:54:46,337 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059a3217a2809735664619b21d588755 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:54:46,338 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:46,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x243af323 to 127.0.0.1:58236 2023-03-28 05:54:46,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:46,338 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:46,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ee9f8a5 to 127.0.0.1:58236 2023-03-28 05:54:46,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:46,338 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c7d445e to 127.0.0.1:58236 2023-03-28 05:54:46,338 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:46,339 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:46,339 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x572ecbef to 127.0.0.1:58236 2023-03-28 05:54:46,339 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:46,339 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:54:46,339 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e60e869 to 127.0.0.1:58236 2023-03-28 05:54:46,339 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:54:46,363 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204406172259c749ddba4d8239a74a0761 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204406172259c749ddba4d8239a74a0761 2023-03-28 05:54:46,386 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/95f0cc147c3b44e0a9eef75d46b043ba 2023-03-28 05:54:46,393 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/95f0cc147c3b44e0a9eef75d46b043ba as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/95f0cc147c3b44e0a9eef75d46b043ba 2023-03-28 05:54:46,405 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/95f0cc147c3b44e0a9eef75d46b043ba, entries=1, sequenceid=41, filesize=5.0 K 2023-03-28 05:54:46,406 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059a3217a2809735664619b21d588755 in 69ms, sequenceid=41, compaction requested=true 2023-03-28 05:54:46,406 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:46,406 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:46,406 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:54:46,406 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:54:46,406 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,406 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-28 05:54:46,406 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-28 05:54:46,644 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:46,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-28 05:54:46,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75f74347[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:46,647 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-28 05:54:46,647 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,649 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,649 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-28 05:54:46,649 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-28 05:54:46,649 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:46,649 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,650 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:46,651 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-28 05:54:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:46,651 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-28 05:54:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:46,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-28 05:54:46,653 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-28 05:54:46,654 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:46,654 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:46,654 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,654 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:46,655 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:46,656 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,659 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:46,662 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,662 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:46,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:46,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,665 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-28 05:54:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:46,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,666 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:46,666 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:46,666 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:46,666 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:46,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:46,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:46,766 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:46,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:46,768 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:46,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:46,770 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:46,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:46,774 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983486774 2023-03-28 05:54:46,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:46,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-28 05:54:46,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:46,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x41be700b to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:46,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ff150b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:46,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,646 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038e853116af814d138aee4c75da6a6c40 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038e853116af814d138aee4c75da6a6c40 2023-03-28 05:54:47,647 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:47,660 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:47,661 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:47,668 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:47,669 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39468, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:47,680 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6e3074582104acb9f144ea5530c350e first=Optional[r3] last=Optional[r6] 2023-03-28 05:54:47,680 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6e3074582104acb9f144ea5530c350e}] 2023-03-28 05:54:47,685 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6e3074582104acb9f144ea5530c350e for inclusion in 059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:47,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-28 05:54:47,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:47,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:47,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c6e3074582104acb9f144ea5530c350e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tbcqfrgnvnlpssi98oq78cg7mdne0e7c9hhtpdolu03hmp0v47l8to8n0ioq7bul/family1/c6e3074582104acb9f144ea5530c350e 2023-03-28 05:54:47,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tbcqfrgnvnlpssi98oq78cg7mdne0e7c9hhtpdolu03hmp0v47l8to8n0ioq7bul/family1/c6e3074582104acb9f144ea5530c350e as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_ 2023-03-28 05:54:47,694 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tbcqfrgnvnlpssi98oq78cg7mdne0e7c9hhtpdolu03hmp0v47l8to8n0ioq7bul/family1/c6e3074582104acb9f144ea5530c350e into 059a3217a2809735664619b21d588755/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_ - updating store file list. 2023-03-28 05:54:47,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_ into 059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:47,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tbcqfrgnvnlpssi98oq78cg7mdne0e7c9hhtpdolu03hmp0v47l8to8n0ioq7bul/family1/c6e3074582104acb9f144ea5530c350e into 059a3217a2809735664619b21d588755/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_) 2023-03-28 05:54:47,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__tbcqfrgnvnlpssi98oq78cg7mdne0e7c9hhtpdolu03hmp0v47l8to8n0ioq7bul/family1/c6e3074582104acb9f144ea5530c350e 2023-03-28 05:54:47,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-28 05:54:47,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-28 05:54:47,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(1912): 059a3217a2809735664619b21d588755/family1 is initiating minor compaction 2023-03-28 05:54:47,702 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 059a3217a2809735664619b21d588755/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:47,702 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/ee54296186384cd6908c26a41008a1d2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/9d302bf3abc340c09314b4dee5e6e988, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/d35367837cc244fd94db892fc353ec60, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/6e00d5b05bf44d5886e55489f42d83cd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/17506566d6784629b0c3b38d11405a2e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/04de76b432b4435694749a8a2b6350b5, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/8349414c6bc84568bd8665714d592111, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/a30520f830c14ad0bbf00d7e3807307a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/95f0cc147c3b44e0a9eef75d46b043ba, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp, totalSize=50.3 K 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting ee54296186384cd6908c26a41008a1d2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 9d302bf3abc340c09314b4dee5e6e988, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting d35367837cc244fd94db892fc353ec60, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 6e00d5b05bf44d5886e55489f42d83cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 17506566d6784629b0c3b38d11405a2e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 04de76b432b4435694749a8a2b6350b5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 8349414c6bc84568bd8665714d592111, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a30520f830c14ad0bbf00d7e3807307a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 95f0cc147c3b44e0a9eef75d46b043ba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-28 05:54:47,703 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-28 05:54:47,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7c444ecd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:47,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:47,707 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:47,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512280c36c11b11cf4428b4eb71854f9df9cd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512280c36c11b11cf4428b4eb71854f9df9cd 2023-03-28 05:54:47,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123128fbda6104ac402a8a5abbd8941b5969 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123128fbda6104ac402a8a5abbd8941b5969 2023-03-28 05:54:47,713 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601018cef78442c864ef18ee7c346b51b3ae7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601018cef78442c864ef18ee7c346b51b3ae7 2023-03-28 05:54:47,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103dd70670889ce49c4bf4e6a4755814071 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103dd70670889ce49c4bf4e6a4755814071 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-28 05:54:47,715 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,773 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 059a3217a2809735664619b21d588755#family1#compaction#73 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:47,815 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f7fc64e24c7741ce9be9ad4f4551c87f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f7fc64e24c7741ce9be9ad4f4551c87f 2023-03-28 05:54:47,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:47,846 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a52f7e87fe6a4142a725b611c25866fa first=Optional[r00] last=Optional[r2] 2023-03-28 05:54:47,847 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a52f7e87fe6a4142a725b611c25866fa}] 2023-03-28 05:54:47,850 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a52f7e87fe6a4142a725b611c25866fa for inclusion in 059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:47,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-28 05:54:47,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:47,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:47,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a52f7e87fe6a4142a725b611c25866fa to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__bifdsocb11i0hagt2mv216n0hf7an4ofqn4ehnb5v7cvq2538pmumd8pbpr0shuf/family1/a52f7e87fe6a4142a725b611c25866fa 2023-03-28 05:54:47,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__bifdsocb11i0hagt2mv216n0hf7an4ofqn4ehnb5v7cvq2538pmumd8pbpr0shuf/family1/a52f7e87fe6a4142a725b611c25866fa as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_ 2023-03-28 05:54:47,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__bifdsocb11i0hagt2mv216n0hf7an4ofqn4ehnb5v7cvq2538pmumd8pbpr0shuf/family1/a52f7e87fe6a4142a725b611c25866fa into 059a3217a2809735664619b21d588755/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_ - updating store file list. 2023-03-28 05:54:47,863 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_ into 059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:47,863 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__bifdsocb11i0hagt2mv216n0hf7an4ofqn4ehnb5v7cvq2538pmumd8pbpr0shuf/family1/a52f7e87fe6a4142a725b611c25866fa into 059a3217a2809735664619b21d588755/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_) 2023-03-28 05:54:47,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__bifdsocb11i0hagt2mv216n0hf7an4ofqn4ehnb5v7cvq2538pmumd8pbpr0shuf/family1/a52f7e87fe6a4142a725b611c25866fa 2023-03-28 05:54:47,866 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:47,866 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:47,868 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306f6e960afc774310a680c8b163a6c1ab to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511306f6e960afc774310a680c8b163a6c1ab 2023-03-28 05:54:47,869 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201115501093f2e45c2b94d357f6c3dd03d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201115501093f2e45c2b94d357f6c3dd03d 2023-03-28 05:54:47,870 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053eb84dde80534297b0197e2d9cdaa007 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053eb84dde80534297b0197e2d9cdaa007 2023-03-28 05:54:47,870 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-28 05:54:47,870 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-28 05:54:47,870 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:47,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:47,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:47,871 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:47,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.1020 sec 2023-03-28 05:54:47,988 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-28 05:54:47,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:48,006 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-28 05:54:48,008 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:48,008 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-28 05:54:48,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-28 05:54:48,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE}] 2023-03-28 05:54:48,017 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE 2023-03-28 05:54:48,018 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:48,018 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982888018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982888018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982888018"}]},"ts":"1679982888018"} 2023-03-28 05:54:48,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:48,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 059a3217a2809735664619b21d588755 2023-03-28 05:54:48,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 059a3217a2809735664619b21d588755, disabling compactions & flushes 2023-03-28 05:54:48,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,214 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/0c042b7c4e774206be048b33be2ffd72 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0c042b7c4e774206be048b33be2ffd72 2023-03-28 05:54:48,222 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 059a3217a2809735664619b21d588755/family1 of 059a3217a2809735664619b21d588755 into 0c042b7c4e774206be048b33be2ffd72(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:48,222 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:48,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. after waiting 0 ms 2023-03-28 05:54:48,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,222 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679982887702; duration=0sec 2023-03-28 05:54:48,222 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:48,224 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/ee54296186384cd6908c26a41008a1d2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/9d302bf3abc340c09314b4dee5e6e988, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/d35367837cc244fd94db892fc353ec60, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/6e00d5b05bf44d5886e55489f42d83cd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/17506566d6784629b0c3b38d11405a2e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/04de76b432b4435694749a8a2b6350b5, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/8349414c6bc84568bd8665714d592111, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/a30520f830c14ad0bbf00d7e3807307a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/95f0cc147c3b44e0a9eef75d46b043ba, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_] to archive 2023-03-28 05:54:48,225 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:48,228 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/ee54296186384cd6908c26a41008a1d2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/ee54296186384cd6908c26a41008a1d2 2023-03-28 05:54:48,229 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/9d302bf3abc340c09314b4dee5e6e988 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/9d302bf3abc340c09314b4dee5e6e988 2023-03-28 05:54:48,231 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/d35367837cc244fd94db892fc353ec60 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/d35367837cc244fd94db892fc353ec60 2023-03-28 05:54:48,233 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/6e00d5b05bf44d5886e55489f42d83cd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/6e00d5b05bf44d5886e55489f42d83cd 2023-03-28 05:54:48,235 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/17506566d6784629b0c3b38d11405a2e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/17506566d6784629b0c3b38d11405a2e 2023-03-28 05:54:48,236 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/04de76b432b4435694749a8a2b6350b5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/04de76b432b4435694749a8a2b6350b5 2023-03-28 05:54:48,238 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/8349414c6bc84568bd8665714d592111 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/8349414c6bc84568bd8665714d592111 2023-03-28 05:54:48,240 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/a30520f830c14ad0bbf00d7e3807307a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/a30520f830c14ad0bbf00d7e3807307a 2023-03-28 05:54:48,241 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/95f0cc147c3b44e0a9eef75d46b043ba to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/95f0cc147c3b44e0a9eef75d46b043ba 2023-03-28 05:54:48,243 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/3ac2264f6c764bd1bd6e5fd5d7f6eda1_SeqId_44_ 2023-03-28 05:54:48,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-28 05:54:48,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:48,254 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 059a3217a2809735664619b21d588755 to self. 2023-03-28 05:54:48,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 059a3217a2809735664619b21d588755 2023-03-28 05:54:48,256 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=CLOSED 2023-03-28 05:54:48,257 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982888256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982888256"}]},"ts":"1679982888256"} 2023-03-28 05:54:48,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-28 05:54:48,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904 in 239 msec 2023-03-28 05:54:48,260 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=true 2023-03-28 05:54:48,411 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:48,411 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982888411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982888411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982888411"}]},"ts":"1679982888411"} 2023-03-28 05:54:48,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:48,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 059a3217a2809735664619b21d588755, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:48,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 059a3217a2809735664619b21d588755 2023-03-28 05:54:48,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:48,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 059a3217a2809735664619b21d588755 2023-03-28 05:54:48,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 059a3217a2809735664619b21d588755 2023-03-28 05:54:48,570 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 059a3217a2809735664619b21d588755 2023-03-28 05:54:48,571 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:48,571 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:48,571 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 059a3217a2809735664619b21d588755 columnFamilyName family1 2023-03-28 05:54:48,577 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0c042b7c4e774206be048b33be2ffd72 2023-03-28 05:54:48,580 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_ 2023-03-28 05:54:48,583 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/723f3ba3b5e94cb68ffe3765b6a16593 2023-03-28 05:54:48,583 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(310): Store=059a3217a2809735664619b21d588755/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:48,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:48,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:48,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 059a3217a2809735664619b21d588755 2023-03-28 05:54:48,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 059a3217a2809735664619b21d588755; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62779675, jitterRate=-0.06450994312763214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:48,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:48,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., pid=63, masterSystemTime=1679982888564 2023-03-28 05:54:48,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:48,590 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-28 05:54:48,591 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-28 05:54:48,591 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1912): 059a3217a2809735664619b21d588755/family1 is initiating minor compaction (all files) 2023-03-28 05:54:48,591 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 059a3217a2809735664619b21d588755/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,591 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/723f3ba3b5e94cb68ffe3765b6a16593, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0c042b7c4e774206be048b33be2ffd72, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp, totalSize=388.1 K 2023-03-28 05:54:48,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:48,592 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 723f3ba3b5e94cb68ffe3765b6a16593, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843296 2023-03-28 05:54:48,592 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:48,592 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982888592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982888592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982888592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982888592"}]},"ts":"1679982888592"} 2023-03-28 05:54:48,592 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 0c042b7c4e774206be048b33be2ffd72, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243296 2023-03-28 05:54:48,593 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878843296 2023-03-28 05:54:48,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-28 05:54:48,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904 in 181 msec 2023-03-28 05:54:48,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-28 05:54:48,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE in 580 msec 2023-03-28 05:54:48,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-28 05:54:48,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 589 msec 2023-03-28 05:54:48,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 615 msec 2023-03-28 05:54:48,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-28 05:54:48,613 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 059a3217a2809735664619b21d588755#family1#compaction#74 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:48,617 INFO [Listener at localhost/33463] compactions.TestMobCompactor(278): alter status finished 2023-03-28 05:54:48,618 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:48,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:48,622 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:48,622 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983488622 2023-03-28 05:54:48,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:48,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:48,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-28 05:54:48,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:48,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x04d49f2c to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:48,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8948e76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:48,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,682 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f03ba5b9fa854f3bab87318578900b79 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128f03ba5b9fa854f3bab87318578900b79 2023-03-28 05:54:48,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:48,702 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:48,703 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33418, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:48,709 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:48,711 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39472, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:48,720 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a9a91d15cc94778bc37c940da15efa9 first=Optional[r05] last=Optional[r8] 2023-03-28 05:54:48,721 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=50 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a9a91d15cc94778bc37c940da15efa9}] 2023-03-28 05:54:48,725 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a9a91d15cc94778bc37c940da15efa9 for inclusion in 059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:48,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-28 05:54:48,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:48,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:48,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a9a91d15cc94778bc37c940da15efa9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ph3q22jhikpj4onns45susk87t25rp7tt0e12ucm1cufvj37nmh6bkbi8po7h1c4/family1/2a9a91d15cc94778bc37c940da15efa9 2023-03-28 05:54:48,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ph3q22jhikpj4onns45susk87t25rp7tt0e12ucm1cufvj37nmh6bkbi8po7h1c4/family1/2a9a91d15cc94778bc37c940da15efa9 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0660fa601e8445ebab7f18ec453c7191_SeqId_52_ 2023-03-28 05:54:48,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ph3q22jhikpj4onns45susk87t25rp7tt0e12ucm1cufvj37nmh6bkbi8po7h1c4/family1/2a9a91d15cc94778bc37c940da15efa9 into 059a3217a2809735664619b21d588755/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0660fa601e8445ebab7f18ec453c7191_SeqId_52_ - updating store file list. 2023-03-28 05:54:48,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0660fa601e8445ebab7f18ec453c7191_SeqId_52_ into 059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:48,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ph3q22jhikpj4onns45susk87t25rp7tt0e12ucm1cufvj37nmh6bkbi8po7h1c4/family1/2a9a91d15cc94778bc37c940da15efa9 into 059a3217a2809735664619b21d588755/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0660fa601e8445ebab7f18ec453c7191_SeqId_52_) 2023-03-28 05:54:48,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ph3q22jhikpj4onns45susk87t25rp7tt0e12ucm1cufvj37nmh6bkbi8po7h1c4/family1/2a9a91d15cc94778bc37c940da15efa9 2023-03-28 05:54:48,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:48,741 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:48,743 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204406172259c749ddba4d8239a74a0761 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204406172259c749ddba4d8239a74a0761 2023-03-28 05:54:48,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285a9cb81598ff421981b0de26b107fdbc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285a9cb81598ff421981b0de26b107fdbc 2023-03-28 05:54:48,744 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-28 05:54:48,744 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-28 05:54:48,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:48,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:48,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:48,746 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:48,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 127 msec 2023-03-28 05:54:48,807 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-28 05:54:48,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:49,222 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-28 05:54:49,223 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-28 05:54:49,223 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-28 05:54:49,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-28 05:54:49,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE}] 2023-03-28 05:54:49,230 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE 2023-03-28 05:54:49,230 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:49,230 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982889230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982889230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982889230"}]},"ts":"1679982889230"} 2023-03-28 05:54:49,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:49,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 059a3217a2809735664619b21d588755 2023-03-28 05:54:49,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 059a3217a2809735664619b21d588755, disabling compactions & flushes 2023-03-28 05:54:49,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,458 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/.tmp/family1/262cb165317143208a597f91162310fe as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/262cb165317143208a597f91162310fe 2023-03-28 05:54:49,463 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 059a3217a2809735664619b21d588755/family1 of 059a3217a2809735664619b21d588755 into 262cb165317143208a597f91162310fe(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:49,463 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:49,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,463 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., storeName=059a3217a2809735664619b21d588755/family1, priority=13, startTime=1679982888589; duration=0sec 2023-03-28 05:54:49,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,464 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:49,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. after waiting 0 ms 2023-03-28 05:54:49,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,464 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/723f3ba3b5e94cb68ffe3765b6a16593, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0c042b7c4e774206be048b33be2ffd72, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_] to archive 2023-03-28 05:54:49,465 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:49,467 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/723f3ba3b5e94cb68ffe3765b6a16593 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/723f3ba3b5e94cb68ffe3765b6a16593 2023-03-28 05:54:49,468 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0c042b7c4e774206be048b33be2ffd72 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0c042b7c4e774206be048b33be2ffd72 2023-03-28 05:54:49,469 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/2cfde986cb3f405fa9cfc15eff696c05_SeqId_46_ 2023-03-28 05:54:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-28 05:54:49,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:49,474 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 059a3217a2809735664619b21d588755 to self. 2023-03-28 05:54:49,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 059a3217a2809735664619b21d588755 2023-03-28 05:54:49,476 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=CLOSED 2023-03-28 05:54:49,476 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982889476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982889476"}]},"ts":"1679982889476"} 2023-03-28 05:54:49,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-28 05:54:49,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904 in 245 msec 2023-03-28 05:54:49,479 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=true 2023-03-28 05:54:49,629 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:49,629 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982889629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982889629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982889629"}]},"ts":"1679982889629"} 2023-03-28 05:54:49,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:49,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 059a3217a2809735664619b21d588755, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:49,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 059a3217a2809735664619b21d588755 2023-03-28 05:54:49,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:49,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 059a3217a2809735664619b21d588755 2023-03-28 05:54:49,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 059a3217a2809735664619b21d588755 2023-03-28 05:54:49,798 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 059a3217a2809735664619b21d588755 2023-03-28 05:54:49,799 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:49,799 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1 2023-03-28 05:54:49,800 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 059a3217a2809735664619b21d588755 columnFamilyName family1 2023-03-28 05:54:49,805 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/0660fa601e8445ebab7f18ec453c7191_SeqId_52_ 2023-03-28 05:54:49,810 DEBUG [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/family1/262cb165317143208a597f91162310fe 2023-03-28 05:54:49,810 INFO [StoreOpener-059a3217a2809735664619b21d588755-1] regionserver.HStore(310): Store=059a3217a2809735664619b21d588755/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:49,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:49,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755 2023-03-28 05:54:49,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 059a3217a2809735664619b21d588755 2023-03-28 05:54:49,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 059a3217a2809735664619b21d588755; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75417008, jitterRate=0.12380099296569824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:49,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:54:49,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755., pid=69, masterSystemTime=1679982889794 2023-03-28 05:54:49,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:54:49,819 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=059a3217a2809735664619b21d588755, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:49,819 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679982889819"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982889819"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982889819"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982889819"}]},"ts":"1679982889819"} 2023-03-28 05:54:49,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-28 05:54:49,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 059a3217a2809735664619b21d588755, server=jenkins-hbase4.apache.org,39167,1679982818904 in 179 msec 2023-03-28 05:54:49,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-28 05:54:49,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=059a3217a2809735664619b21d588755, REOPEN/MOVE in 593 msec 2023-03-28 05:54:49,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-28 05:54:49,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 599 msec 2023-03-28 05:54:49,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0240 sec 2023-03-28 05:54:49,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-28 05:54:49,836 INFO [Listener at localhost/33463] compactions.TestMobCompactor(278): alter status finished 2023-03-28 05:54:49,837 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-28 05:54:49,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:49,839 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:49,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:49,840 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983489840 2023-03-28 05:54:49,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:54:49,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-28 05:54:49,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:49,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x34dff220 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:49,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fa8e44, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-28 05:54:49,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-28 05:54:49,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:49,858 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-28 05:54:49,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 20 msec 2023-03-28 05:54:49,930 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=247 (was 257), OpenFileDescriptor=619 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=377 (was 386), ProcessCount=171 (was 171), AvailableMemoryMB=4237 (was 4355) 2023-03-28 05:54:49,945 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=247, OpenFileDescriptor=619, MaxFileDescriptor=60000, SystemLoadAverage=377, ProcessCount=171, AvailableMemoryMB=4237 2023-03-28 05:54:49,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-28 05:54:49,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:49,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:54:49,951 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-28 05:54:49,952 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:54:49,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-28 05:54:49,957 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:49,958 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c empty. 2023-03-28 05:54:49,958 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:49,958 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-28 05:54:50,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-28 05:54:50,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-28 05:54:50,374 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:50,375 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 46813f25411d96c229bb4c9e1a5c6d8c, NAME => 'testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:50,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-28 05:54:50,782 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:50,782 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 46813f25411d96c229bb4c9e1a5c6d8c, disabling compactions & flushes 2023-03-28 05:54:50,782 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:50,782 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:50,782 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. after waiting 0 ms 2023-03-28 05:54:50,782 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:50,782 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:50,782 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 46813f25411d96c229bb4c9e1a5c6d8c: 2023-03-28 05:54:50,784 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:54:50,785 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679982890785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982890785"}]},"ts":"1679982890785"} 2023-03-28 05:54:50,787 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:54:50,787 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:54:50,788 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982890787"}]},"ts":"1679982890787"} 2023-03-28 05:54:50,788 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-28 05:54:50,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=46813f25411d96c229bb4c9e1a5c6d8c, ASSIGN}] 2023-03-28 05:54:50,794 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=46813f25411d96c229bb4c9e1a5c6d8c, ASSIGN 2023-03-28 05:54:50,794 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=46813f25411d96c229bb4c9e1a5c6d8c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:50,945 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=46813f25411d96c229bb4c9e1a5c6d8c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:50,946 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679982890945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982890945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982890945"}]},"ts":"1679982890945"} 2023-03-28 05:54:50,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 46813f25411d96c229bb4c9e1a5c6d8c, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:51,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-28 05:54:51,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:51,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46813f25411d96c229bb4c9e1a5c6d8c, NAME => 'testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:54:51,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-28 05:54:51,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-28 05:54:51,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:51,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:51,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:51,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:51,106 INFO [StoreOpener-46813f25411d96c229bb4c9e1a5c6d8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:51,107 DEBUG [StoreOpener-46813f25411d96c229bb4c9e1a5c6d8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1 2023-03-28 05:54:51,107 DEBUG [StoreOpener-46813f25411d96c229bb4c9e1a5c6d8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1 2023-03-28 05:54:51,107 INFO [StoreOpener-46813f25411d96c229bb4c9e1a5c6d8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46813f25411d96c229bb4c9e1a5c6d8c columnFamilyName f1 2023-03-28 05:54:51,109 INFO [StoreOpener-46813f25411d96c229bb4c9e1a5c6d8c-1] regionserver.HStore(310): Store=46813f25411d96c229bb4c9e1a5c6d8c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:51,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:51,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:51,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:51,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:51,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 46813f25411d96c229bb4c9e1a5c6d8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62721303, jitterRate=-0.06537975370883942}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:54:51,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 46813f25411d96c229bb4c9e1a5c6d8c: 2023-03-28 05:54:51,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c., pid=73, masterSystemTime=1679982891099 2023-03-28 05:54:51,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:51,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:51,118 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=46813f25411d96c229bb4c9e1a5c6d8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:51,118 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679982891117"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982891117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982891117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982891117"}]},"ts":"1679982891117"} 2023-03-28 05:54:51,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-28 05:54:51,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 46813f25411d96c229bb4c9e1a5c6d8c, server=jenkins-hbase4.apache.org,39167,1679982818904 in 172 msec 2023-03-28 05:54:51,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-28 05:54:51,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=46813f25411d96c229bb4c9e1a5c6d8c, ASSIGN in 328 msec 2023-03-28 05:54:51,122 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:54:51,122 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982891122"}]},"ts":"1679982891122"} 2023-03-28 05:54:51,123 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-28 05:54:51,125 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:54:51,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1760 sec 2023-03-28 05:54:52,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-28 05:54:52,058 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-28 05:54:52,058 DEBUG [Listener at localhost/33463] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-28 05:54:52,060 INFO [Listener at localhost/33463] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-28 05:54:52,064 INFO [Listener at localhost/33463] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-28 05:54:52,064 INFO [Listener at localhost/33463] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-28 05:54:52,064 INFO [Listener at localhost/33463] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-28 05:54:52,069 INFO [Listener at localhost/33463] regionserver.HRegion(2745): Flushing 46813f25411d96c229bb4c9e1a5c6d8c 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-28 05:54:52,482 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328ed8d303826f742cfb6b374f50f11d627 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230328ed8d303826f742cfb6b374f50f11d627 2023-03-28 05:54:52,890 INFO [Listener at localhost/33463] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/.tmp/f1/a43abae08d11446daceed8ad238ab392 2023-03-28 05:54:52,896 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/.tmp/f1/a43abae08d11446daceed8ad238ab392 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392 2023-03-28 05:54:52,902 INFO [Listener at localhost/33463] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392, entries=1, sequenceid=5, filesize=4.9 K 2023-03-28 05:54:52,903 INFO [Listener at localhost/33463] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 46813f25411d96c229bb4c9e1a5c6d8c in 834ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:52,903 DEBUG [Listener at localhost/33463] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-28 05:54:52,904 DEBUG [Listener at localhost/33463] regionserver.HRegion(2446): Flush status journal for 46813f25411d96c229bb4c9e1a5c6d8c: 2023-03-28 05:54:52,906 INFO [Listener at localhost/33463] regionserver.HRegion(2745): Flushing 46813f25411d96c229bb4c9e1a5c6d8c 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-28 05:54:53,320 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032805b79d5bcf0d495988f5fb8675765366 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023032805b79d5bcf0d495988f5fb8675765366 2023-03-28 05:54:53,334 INFO [Listener at localhost/33463] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/.tmp/f1/bcf498837c44410d9023ad9f2551f988 2023-03-28 05:54:53,341 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/.tmp/f1/bcf498837c44410d9023ad9f2551f988 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988 2023-03-28 05:54:53,348 INFO [Listener at localhost/33463] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988, entries=1, sequenceid=9, filesize=4.9 K 2023-03-28 05:54:53,349 INFO [Listener at localhost/33463] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 46813f25411d96c229bb4c9e1a5c6d8c in 443ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:53,349 DEBUG [Listener at localhost/33463] regionserver.HRegion(2446): Flush status journal for 46813f25411d96c229bb4c9e1a5c6d8c: 2023-03-28 05:54:53,352 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-28 05:54:53,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-28 05:54:53,355 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-28 05:54:53,356 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983493356 2023-03-28 05:54:53,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:53,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-28 05:54:53,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-28 05:54:53,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-28 05:54:53,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x396e402c to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:54:53,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d3271eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:54:53,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230328 for table='testGetAfterCompaction' and column='f1' 2023-03-28 05:54:53,407 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,407 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,458 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,458 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,509 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,509 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,560 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,560 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,611 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,611 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,662 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,662 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,713 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,713 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,764 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,764 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,799 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:54:53,815 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,815 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,842 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303286df747d9556c4c3ab42ebada473e395a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303286df747d9556c4c3ab42ebada473e395a 2023-03-28 05:54:53,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testGetAfterCompaction' column='f1' 2023-03-28 05:54:53,863 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:54:53,865 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44712, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:54:53,867 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,867 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,872 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:54:53,875 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35330, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:54:53,887 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/f1/541b31f7307340bb9f5b6cbe915b0556 first=Optional[r1] last=Optional[r2] 2023-03-28 05:54:53,888 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{f1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/f1/541b31f7307340bb9f5b6cbe915b0556}] 2023-03-28 05:54:53,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/f1/541b31f7307340bb9f5b6cbe915b0556 for inclusion in 46813f25411d96c229bb4c9e1a5c6d8c/f1 2023-03-28 05:54:53,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-28 05:54:53,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:54:53,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 46813f25411d96c229bb4c9e1a5c6d8c: 2023-03-28 05:54:53,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/f1/541b31f7307340bb9f5b6cbe915b0556 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testGetAfterCompaction__4q6oh5g0cecjq7r07g1nr6bim48upgg842ohcpa168d9c0ni5thq524nlhc7t4cd/f1/541b31f7307340bb9f5b6cbe915b0556 2023-03-28 05:54:53,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testGetAfterCompaction__4q6oh5g0cecjq7r07g1nr6bim48upgg842ohcpa168d9c0ni5thq524nlhc7t4cd/f1/541b31f7307340bb9f5b6cbe915b0556 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_ 2023-03-28 05:54:53,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testGetAfterCompaction__4q6oh5g0cecjq7r07g1nr6bim48upgg842ohcpa168d9c0ni5thq524nlhc7t4cd/f1/541b31f7307340bb9f5b6cbe915b0556 into 46813f25411d96c229bb4c9e1a5c6d8c/f1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_ - updating store file list. 2023-03-28 05:54:53,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_ into 46813f25411d96c229bb4c9e1a5c6d8c/f1 2023-03-28 05:54:53,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testGetAfterCompaction__4q6oh5g0cecjq7r07g1nr6bim48upgg842ohcpa168d9c0ni5thq524nlhc7t4cd/f1/541b31f7307340bb9f5b6cbe915b0556 into 46813f25411d96c229bb4c9e1a5c6d8c/f1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_) 2023-03-28 05:54:53,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testGetAfterCompaction__4q6oh5g0cecjq7r07g1nr6bim48upgg842ohcpa168d9c0ni5thq524nlhc7t4cd/f1/541b31f7307340bb9f5b6cbe915b0556 2023-03-28 05:54:53,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(1912): 46813f25411d96c229bb4c9e1a5c6d8c/f1 is initiating minor compaction 2023-03-28 05:54:53,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@59833d7c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:53,912 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 46813f25411d96c229bb4c9e1a5c6d8c/f1 in testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:53,912 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/.tmp, totalSize=10.0 K 2023-03-28 05:54:53,912 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting bcf498837c44410d9023ad9f2551f988, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:54:53,912 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:54:53,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testGetAfterCompaction' column='f1' 2023-03-28 05:54:53,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:53,917 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023032805b79d5bcf0d495988f5fb8675765366 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023032805b79d5bcf0d495988f5fb8675765366 2023-03-28 05:54:53,920 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:53,920 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,920 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230328ed8d303826f742cfb6b374f50f11d627 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230328ed8d303826f742cfb6b374f50f11d627 2023-03-28 05:54:53,922 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-28 05:54:53,922 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230328' 2023-03-28 05:54:53,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230328 for table='testGetAfterCompaction' and column='f1' 2023-03-28 05:54:53,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-28 05:54:53,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:54:53,924 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-28 05:54:53,924 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 46813f25411d96c229bb4c9e1a5c6d8c#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:54:53,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 571 msec 2023-03-28 05:54:53,929 DEBUG [Listener at localhost/33463] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-28 05:54:53,939 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44718, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-28 05:54:53,939 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39167] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:53,939 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-28 05:54:53,940 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-28 05:54:53,940 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39167] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-28 05:54:53,940 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39167] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. because compaction request was cancelled 2023-03-28 05:54:53,991 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:53,992 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:53,992 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,042 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:54,042 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,042 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,093 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:54,093 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,093 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,144 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:54,144 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,144 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,195 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:54,195 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,195 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,246 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:54,246 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,246 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,297 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:54,297 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,297 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,348 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679982893837; access_time=1679982893407; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-28 05:54:54,348 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,348 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982893334; access_time=1679982892908; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,351 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/.tmp/f1/620e9ee4691240228e43c2da76406d7d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/620e9ee4691240228e43c2da76406d7d 2023-03-28 05:54:54,356 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 46813f25411d96c229bb4c9e1a5c6d8c/f1 of 46813f25411d96c229bb4c9e1a5c6d8c into 620e9ee4691240228e43c2da76406d7d(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:54:54,356 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46813f25411d96c229bb4c9e1a5c6d8c: 2023-03-28 05:54:54,356 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1679982893912; duration=0sec 2023-03-28 05:54:54,356 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:54:54,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_] to archive 2023-03-28 05:54:54,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:54:54,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/bcf498837c44410d9023ad9f2551f988 2023-03-28 05:54:54,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/18f4cf77d0984b2abc47390ade6a2dbb_SeqId_12_ 2023-03-28 05:54:54,399 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/620e9ee4691240228e43c2da76406d7d; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1679982894346; access_time=1679982893921; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,399 INFO [Listener at localhost/33463] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679982892889; access_time=1679982892072; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-28 05:54:54,524 INFO [Listener at localhost/33463] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-28 05:54:54,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-03-28 05:54:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:54,541 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982894541"}]},"ts":"1679982894541"} 2023-03-28 05:54:54,543 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-28 05:54:54,545 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-28 05:54:54,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-28 05:54:54,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=46813f25411d96c229bb4c9e1a5c6d8c, UNASSIGN}] 2023-03-28 05:54:54,548 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=46813f25411d96c229bb4c9e1a5c6d8c, UNASSIGN 2023-03-28 05:54:54,549 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=46813f25411d96c229bb4c9e1a5c6d8c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:54,549 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679982894549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982894549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982894549"}]},"ts":"1679982894549"} 2023-03-28 05:54:54,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 46813f25411d96c229bb4c9e1a5c6d8c, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:54,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-28 05:54:54,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:54,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 46813f25411d96c229bb4c9e1a5c6d8c, disabling compactions & flushes 2023-03-28 05:54:54,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:54,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:54,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. after waiting 0 ms 2023-03-28 05:54:54,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:54,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-28 05:54:54,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-28 05:54:54,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c. 2023-03-28 05:54:54,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 46813f25411d96c229bb4c9e1a5c6d8c: 2023-03-28 05:54:54,746 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=46813f25411d96c229bb4c9e1a5c6d8c, regionState=CLOSED 2023-03-28 05:54:54,746 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679982894746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982894746"}]},"ts":"1679982894746"} 2023-03-28 05:54:54,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:54,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-28 05:54:54,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 46813f25411d96c229bb4c9e1a5c6d8c, server=jenkins-hbase4.apache.org,39167,1679982818904 in 197 msec 2023-03-28 05:54:54,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-28 05:54:54,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=46813f25411d96c229bb4c9e1a5c6d8c, UNASSIGN in 203 msec 2023-03-28 05:54:54,754 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982894754"}]},"ts":"1679982894754"} 2023-03-28 05:54:54,756 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-28 05:54:54,762 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-28 05:54:54,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 231 msec 2023-03-28 05:54:54,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-28 05:54:54,849 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-28 05:54:54,855 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-03-28 05:54:54,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:54,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:54,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:54,873 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:54,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-28 05:54:54,878 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1, FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/recovered.edits] 2023-03-28 05:54:54,884 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/620e9ee4691240228e43c2da76406d7d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/620e9ee4691240228e43c2da76406d7d 2023-03-28 05:54:54,885 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/f1/a43abae08d11446daceed8ad238ab392 2023-03-28 05:54:54,888 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/recovered.edits/15.seqid to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c/recovered.edits/15.seqid 2023-03-28 05:54:54,888 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testGetAfterCompaction/46813f25411d96c229bb4c9e1a5c6d8c 2023-03-28 05:54:54,888 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-28 05:54:54,889 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-28 05:54:54,889 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-28 05:54:54,893 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303286df747d9556c4c3ab42ebada473e395a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303286df747d9556c4c3ab42ebada473e395a 2023-03-28 05:54:54,893 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-28 05:54:54,896 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:54,928 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-28 05:54:54,931 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-28 05:54:54,933 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:54,933 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-28 05:54:54,933 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679982894933"}]},"ts":"9223372036854775807"} 2023-03-28 05:54:54,935 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-28 05:54:54,935 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 46813f25411d96c229bb4c9e1a5c6d8c, NAME => 'testGetAfterCompaction,,1679982889949.46813f25411d96c229bb4c9e1a5c6d8c.', STARTKEY => '', ENDKEY => ''}] 2023-03-28 05:54:54,935 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-28 05:54:54,936 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1679982894936"}]},"ts":"9223372036854775807"} 2023-03-28 05:54:54,937 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-28 05:54:54,940 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-28 05:54:54,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 83 msec 2023-03-28 05:54:54,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-28 05:54:54,975 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-28 05:54:54,992 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=248 (was 247) - Thread LEAK? -, OpenFileDescriptor=623 (was 619) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=451 (was 377) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=4217 (was 4237) 2023-03-28 05:54:55,007 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=248, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=451, ProcessCount=171, AvailableMemoryMB=4216 2023-03-28 05:54:55,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-28 05:54:55,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-28 05:54:55,011 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:54:55,012 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-28 05:54:55,013 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:54:55,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-28 05:54:55,018 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,018 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,018 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841 empty. 2023-03-28 05:54:55,019 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,020 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07 empty. 2023-03-28 05:54:55,020 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02 empty. 2023-03-28 05:54:55,021 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,021 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,021 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,021 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-28 05:54:55,051 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-28 05:54:55,052 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => f2b46b886f1b7cf3ce6017631b923841, NAME => 'testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:55,053 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => df36b35bd32c0c4727983225bdf25a02, NAME => 'testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:55,053 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 87940ac43ab7a9d87409f4d6e787bb07, NAME => 'testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:54:55,092 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:55,093 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing df36b35bd32c0c4727983225bdf25a02, disabling compactions & flushes 2023-03-28 05:54:55,093 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,093 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,093 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. after waiting 0 ms 2023-03-28 05:54:55,093 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,093 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,093 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:54:55,094 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:55,094 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing f2b46b886f1b7cf3ce6017631b923841, disabling compactions & flushes 2023-03-28 05:54:55,094 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,094 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,094 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. after waiting 0 ms 2023-03-28 05:54:55,094 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,094 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,094 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:54:55,095 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:55,095 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 87940ac43ab7a9d87409f4d6e787bb07, disabling compactions & flushes 2023-03-28 05:54:55,095 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,095 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,095 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. after waiting 0 ms 2023-03-28 05:54:55,095 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,095 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,095 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:54:55,101 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:54:55,103 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982895102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982895102"}]},"ts":"1679982895102"} 2023-03-28 05:54:55,103 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982895102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982895102"}]},"ts":"1679982895102"} 2023-03-28 05:54:55,103 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982895102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982895102"}]},"ts":"1679982895102"} 2023-03-28 05:54:55,107 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-28 05:54:55,107 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:54:55,108 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982895108"}]},"ts":"1679982895108"} 2023-03-28 05:54:55,109 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-28 05:54:55,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-28 05:54:55,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN}] 2023-03-28 05:54:55,122 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN 2023-03-28 05:54:55,122 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN 2023-03-28 05:54:55,122 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN 2023-03-28 05:54:55,123 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:55,123 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:55,123 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:54:55,274 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f2b46b886f1b7cf3ce6017631b923841, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,274 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=87940ac43ab7a9d87409f4d6e787bb07, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,274 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=df36b35bd32c0c4727983225bdf25a02, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,275 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982895274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982895274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982895274"}]},"ts":"1679982895274"} 2023-03-28 05:54:55,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982895274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982895274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982895274"}]},"ts":"1679982895274"} 2023-03-28 05:54:55,275 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982895274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982895274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982895274"}]},"ts":"1679982895274"} 2023-03-28 05:54:55,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 87940ac43ab7a9d87409f4d6e787bb07, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:55,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure df36b35bd32c0c4727983225bdf25a02, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:55,279 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure f2b46b886f1b7cf3ce6017631b923841, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:54:55,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-28 05:54:55,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2b46b886f1b7cf3ce6017631b923841, NAME => 'testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.', STARTKEY => '', ENDKEY => '1'} 2023-03-28 05:54:55,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:55,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,436 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,440 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:54:55,440 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:54:55,440 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2b46b886f1b7cf3ce6017631b923841 columnFamilyName family1 2023-03-28 05:54:55,442 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(310): Store=f2b46b886f1b7cf3ce6017631b923841/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:55,443 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,444 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2 2023-03-28 05:54:55,444 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2 2023-03-28 05:54:55,445 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2b46b886f1b7cf3ce6017631b923841 columnFamilyName family2 2023-03-28 05:54:55,448 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(310): Store=f2b46b886f1b7cf3ce6017631b923841/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:55,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:54:55,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:54:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:55,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2b46b886f1b7cf3ce6017631b923841; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66190510, jitterRate=-0.01368454098701477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:54:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:54:55,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841., pid=85, masterSystemTime=1679982895430 2023-03-28 05:54:55,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87940ac43ab7a9d87409f4d6e787bb07, NAME => 'testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.', STARTKEY => '1', ENDKEY => '2'} 2023-03-28 05:54:55,460 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f2b46b886f1b7cf3ce6017631b923841, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:55,461 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982895460"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982895460"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982895460"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982895460"}]},"ts":"1679982895460"} 2023-03-28 05:54:55,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,462 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,463 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:54:55,463 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:54:55,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-03-28 05:54:55,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure f2b46b886f1b7cf3ce6017631b923841, server=jenkins-hbase4.apache.org,39167,1679982818904 in 184 msec 2023-03-28 05:54:55,464 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87940ac43ab7a9d87409f4d6e787bb07 columnFamilyName family1 2023-03-28 05:54:55,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN in 346 msec 2023-03-28 05:54:55,466 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(310): Store=87940ac43ab7a9d87409f4d6e787bb07/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:55,466 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,467 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2 2023-03-28 05:54:55,467 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2 2023-03-28 05:54:55,468 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87940ac43ab7a9d87409f4d6e787bb07 columnFamilyName family2 2023-03-28 05:54:55,468 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(310): Store=87940ac43ab7a9d87409f4d6e787bb07/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:55,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:54:55,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:54:55,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:55,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87940ac43ab7a9d87409f4d6e787bb07; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60870914, jitterRate=-0.09295269846916199}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:54:55,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:54:55,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07., pid=83, masterSystemTime=1679982895430 2023-03-28 05:54:55,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,478 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=87940ac43ab7a9d87409f4d6e787bb07, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,479 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982895478"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982895478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982895478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982895478"}]},"ts":"1679982895478"} 2023-03-28 05:54:55,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => df36b35bd32c0c4727983225bdf25a02, NAME => 'testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.', STARTKEY => '2', ENDKEY => ''} 2023-03-28 05:54:55,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:54:55,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-03-28 05:54:55,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 87940ac43ab7a9d87409f4d6e787bb07, server=jenkins-hbase4.apache.org,39167,1679982818904 in 204 msec 2023-03-28 05:54:55,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN in 364 msec 2023-03-28 05:54:55,483 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,488 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:54:55,488 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:54:55,488 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df36b35bd32c0c4727983225bdf25a02 columnFamilyName family1 2023-03-28 05:54:55,490 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(310): Store=df36b35bd32c0c4727983225bdf25a02/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:55,490 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,492 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2 2023-03-28 05:54:55,492 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2 2023-03-28 05:54:55,492 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df36b35bd32c0c4727983225bdf25a02 columnFamilyName family2 2023-03-28 05:54:55,494 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(310): Store=df36b35bd32c0c4727983225bdf25a02/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:54:55,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:54:55,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:54:55,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:54:55,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened df36b35bd32c0c4727983225bdf25a02; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72482705, jitterRate=0.08007647097110748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:54:55,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:54:55,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02., pid=84, masterSystemTime=1679982895430 2023-03-28 05:54:55,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,504 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=df36b35bd32c0c4727983225bdf25a02, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,504 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982895504"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982895504"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982895504"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982895504"}]},"ts":"1679982895504"} 2023-03-28 05:54:55,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-03-28 05:54:55,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure df36b35bd32c0c4727983225bdf25a02, server=jenkins-hbase4.apache.org,39167,1679982818904 in 228 msec 2023-03-28 05:54:55,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-03-28 05:54:55,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN in 387 msec 2023-03-28 05:54:55,509 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:54:55,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982895509"}]},"ts":"1679982895509"} 2023-03-28 05:54:55,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-28 05:54:55,513 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:54:55,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 504 msec 2023-03-28 05:54:55,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-28 05:54:55,617 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-28 05:54:55,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:55,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:55,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:55,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:55,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-28 05:54:55,635 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-28 05:54:55,635 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:55,635 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-28 05:54:55,635 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-28 05:54:55,635 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:55,635 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:55,637 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:55,637 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:55,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:55,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:55,637 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:55,637 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:55,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:55,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:55,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:55,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-28 05:54:55,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-28 05:54:55,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-28 05:54:55,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:55,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-28 05:54:55,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:55,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:54:55,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:55,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:55,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. started... 2023-03-28 05:54:55,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:55,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. started... 2023-03-28 05:54:55,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. started... 2023-03-28 05:54:55,644 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 87940ac43ab7a9d87409f4d6e787bb07 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:54:55,645 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing df36b35bd32c0c4727983225bdf25a02 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:54:55,645 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f2b46b886f1b7cf3ce6017631b923841 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:54:56,074 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a 2023-03-28 05:54:56,089 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 2023-03-28 05:54:56,089 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 2023-03-28 05:54:56,114 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/9cd2be624432451281d8a112467029bb 2023-03-28 05:54:56,483 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/5146126471d645c8908596ebb9746f58 2023-03-28 05:54:56,502 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/86421ecd2cee47128227a8bf593757a3 2023-03-28 05:54:56,528 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303281479028a6a274c0da0221fd545a3f1c0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303281479028a6a274c0da0221fd545a3f1c0 2023-03-28 05:54:56,899 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032822c1de3ce8ab4d3bbccd0bc98f49929c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032822c1de3ce8ab4d3bbccd0bc98f49929c 2023-03-28 05:54:56,907 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/5396d89c753848b48bd06195dce49392 2023-03-28 05:54:56,913 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/5146126471d645c8908596ebb9746f58 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58 2023-03-28 05:54:56,917 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328b9dbe0d14e1f40c59f5a9e4f7ef4ecf6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328b9dbe0d14e1f40c59f5a9e4f7ef4ecf6 2023-03-28 05:54:56,920 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58, entries=4, sequenceid=5, filesize=5.4 K 2023-03-28 05:54:56,921 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/5396d89c753848b48bd06195dce49392 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392 2023-03-28 05:54:56,927 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:54:56,928 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for df36b35bd32c0c4727983225bdf25a02 in 1283ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:56,928 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-28 05:54:56,929 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:54:56,929 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:56,929 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:54:56,935 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/b37a2350ac8043c5a92b7670a9bda3b2 2023-03-28 05:54:56,942 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/9cd2be624432451281d8a112467029bb as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb 2023-03-28 05:54:56,947 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb, entries=4, sequenceid=5, filesize=5.4 K 2023-03-28 05:54:56,948 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/b37a2350ac8043c5a92b7670a9bda3b2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2 2023-03-28 05:54:56,952 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:54:56,953 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f2b46b886f1b7cf3ce6017631b923841 in 1308ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:56,954 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:54:56,954 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:56,954 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:54:57,325 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/2b62ba8baa164e8b9710a82d996d5382 2023-03-28 05:54:57,330 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/86421ecd2cee47128227a8bf593757a3 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3 2023-03-28 05:54:57,335 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3, entries=4, sequenceid=5, filesize=5.4 K 2023-03-28 05:54:57,336 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/2b62ba8baa164e8b9710a82d996d5382 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382 2023-03-28 05:54:57,339 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:54:57,340 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 87940ac43ab7a9d87409f4d6e787bb07 in 1696ms, sequenceid=5, compaction requested=false 2023-03-28 05:54:57,340 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:54:57,340 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:54:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:54:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-28 05:54:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-28 05:54:57,342 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,342 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:57,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:57,343 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:57,343 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:57,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:57,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:57,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:57,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-28 05:54:57,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@125d35eb[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:57,344 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-28 05:54:57,344 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,347 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,347 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-28 05:54:57,347 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,347 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:57,347 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-28 05:54:57,347 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:57,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-28 05:54:57,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:57,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:57,348 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:57,349 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-28 05:54:57,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:57,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:57,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:57,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:57,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:57,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:57,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-28 05:54:57,351 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-28 05:54:57,351 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:57,351 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:57,351 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-28 05:54:57,351 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:57,352 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,352 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:57,352 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:57,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:57,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:57,353 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,354 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:57,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:57,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,356 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:57,356 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:57,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-28 05:54:57,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-28 05:54:57,356 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:57,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:57,356 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:57,356 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:57,357 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:57,357 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,357 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,357 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:57,357 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,357 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:57,357 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:57,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:57,457 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:57,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:57,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:57,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:57,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:57,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:57,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:57,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-28 05:54:57,468 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-28 05:54:57,469 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:57,469 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-28 05:54:57,469 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-28 05:54:57,469 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,469 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:57,470 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,471 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:57,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:57,471 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:57,471 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:57,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:57,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-28 05:54:57,484 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-28 05:54:57,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-28 05:54:57,484 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-28 05:54:57,484 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:57,484 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-28 05:54:57,484 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:57,485 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. started... 2023-03-28 05:54:57,485 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 87940ac43ab7a9d87409f4d6e787bb07 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:54:57,490 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:57,490 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:54:57,490 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:57,490 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:57,490 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. started... 2023-03-28 05:54:57,490 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. started... 2023-03-28 05:54:57,490 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f2b46b886f1b7cf3ce6017631b923841 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:54:57,490 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing df36b35bd32c0c4727983225bdf25a02 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:54:57,944 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af 2023-03-28 05:54:57,948 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 2023-03-28 05:54:57,954 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e 2023-03-28 05:54:57,961 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/a60410d863dc4e7a9907588fee122dc7 2023-03-28 05:54:57,971 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/8b8130b1a3314a40b2c60e46379e7108 2023-03-28 05:54:57,992 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/345031e3a72c44f7a4ca76b4f80d6012 2023-03-28 05:54:58,029 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328cceb58ac27ee4c899b1d43bfcdc2bb50 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328cceb58ac27ee4c899b1d43bfcdc2bb50 2023-03-28 05:54:58,036 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/6aee4f92673744a79774b113c267a183 2023-03-28 05:54:58,043 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/a60410d863dc4e7a9907588fee122dc7 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7 2023-03-28 05:54:58,049 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303289166684d8c594f91960bbf1538338257 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303289166684d8c594f91960bbf1538338257 2023-03-28 05:54:58,050 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7, entries=4, sequenceid=9, filesize=5.4 K 2023-03-28 05:54:58,052 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/6aee4f92673744a79774b113c267a183 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183 2023-03-28 05:54:58,057 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:54:58,058 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 87940ac43ab7a9d87409f4d6e787bb07 in 573ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:58,058 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:54:58,058 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:58,058 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:54:58,061 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/e7497dd47f5644ccbdedf071442194d3 2023-03-28 05:54:58,066 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/8b8130b1a3314a40b2c60e46379e7108 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108 2023-03-28 05:54:58,071 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108, entries=4, sequenceid=9, filesize=5.4 K 2023-03-28 05:54:58,072 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/e7497dd47f5644ccbdedf071442194d3 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3 2023-03-28 05:54:58,077 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:54:58,079 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f2b46b886f1b7cf3ce6017631b923841 in 589ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:58,079 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:54:58,079 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:58,079 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:54:58,431 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328d3521bb0c2a14c1295ab27bff53eb132 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328d3521bb0c2a14c1295ab27bff53eb132 2023-03-28 05:54:58,436 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/767fecffbc63478b9f4fd5eaf0575c77 2023-03-28 05:54:58,440 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/345031e3a72c44f7a4ca76b4f80d6012 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012 2023-03-28 05:54:58,443 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012, entries=4, sequenceid=9, filesize=5.4 K 2023-03-28 05:54:58,444 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/767fecffbc63478b9f4fd5eaf0575c77 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77 2023-03-28 05:54:58,449 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:54:58,453 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for df36b35bd32c0c4727983225bdf25a02 in 963ms, sequenceid=9, compaction requested=false 2023-03-28 05:54:58,453 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:54:58,453 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:54:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:54:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-28 05:54:58,453 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-28 05:54:58,455 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,455 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:58,456 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,456 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:54:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:58,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-28 05:54:58,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74debf70[Count = 0] remaining members to acquire global barrier 2023-03-28 05:54:58,458 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-28 05:54:58,458 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,459 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,459 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-28 05:54:58,459 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-28 05:54:58,459 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:54:58,459 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,459 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:54:58,462 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,462 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-28 05:54:58,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:58,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:58,462 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:58,462 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-28 05:54:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:54:58,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-28 05:54:58,465 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-28 05:54:58,465 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:54:58,465 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:54:58,465 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-28 05:54:58,465 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:54:58,467 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:54:58,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:54:58,468 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,468 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:58,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,468 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:58,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:58,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:54:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:54:58,471 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:54:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:58,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:58,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:58,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,474 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:54:58,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-28 05:54:58,475 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:54:58,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:58,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:58,474 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:54:58,475 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:54:58,475 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,475 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-28 05:54:58,475 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:54:58,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:54:58,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:54:58,575 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:54:58,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:54:58,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:58,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:58,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:54:58,581 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:54:58,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-28 05:54:58,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-28 05:54:58,583 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-28 05:54:58,583 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:58,583 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-28 05:54:58,583 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-28 05:54:58,588 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,588 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:58,589 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,589 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:54:58,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:54:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:54:58,590 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:54:58,590 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:54:58,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:58,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:54:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:54:58,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:54:58,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-28 05:54:58,596 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-28 05:54:58,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-28 05:54:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-28 05:54:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:54:58,596 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-28 05:54:58,600 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:58,600 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. started... 2023-03-28 05:54:58,600 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:54:58,600 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. started... 2023-03-28 05:54:58,600 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 87940ac43ab7a9d87409f4d6e787bb07 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:54:58,600 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f2b46b886f1b7cf3ce6017631b923841 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:54:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:54:58,601 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:54:58,601 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:58,601 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. started... 2023-03-28 05:54:58,601 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing df36b35bd32c0c4727983225bdf25a02 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:54:58,639 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 2023-03-28 05:54:59,030 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 2023-03-28 05:54:59,030 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f 2023-03-28 05:54:59,038 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/b544dffd423f459bbd078c742b997656 2023-03-28 05:54:59,045 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/bb9d12c1ef55466984d68b5fbebefbd2 2023-03-28 05:54:59,051 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032870e0acb3f55b4b0da260c20877556448 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032870e0acb3f55b4b0da260c20877556448 2023-03-28 05:54:59,065 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303280a28bc7508b84d568254ae381787f24f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303280a28bc7508b84d568254ae381787f24f 2023-03-28 05:54:59,436 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/1ae98139d3de44de8106f41a0a91af94 2023-03-28 05:54:59,462 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/cded5e69144f441ca8d26234d49134c0 2023-03-28 05:54:59,467 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/b544dffd423f459bbd078c742b997656 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656 2023-03-28 05:54:59,472 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/b1bf347bbcae4069b518fe8072001dcc 2023-03-28 05:54:59,473 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656, entries=4, sequenceid=13, filesize=5.4 K 2023-03-28 05:54:59,474 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/cded5e69144f441ca8d26234d49134c0 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0 2023-03-28 05:54:59,484 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/bb9d12c1ef55466984d68b5fbebefbd2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2 2023-03-28 05:54:59,485 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:54:59,486 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for df36b35bd32c0c4727983225bdf25a02 in 885ms, sequenceid=13, compaction requested=true 2023-03-28 05:54:59,486 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:54:59,486 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:54:59,486 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:54:59,489 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2, entries=4, sequenceid=13, filesize=5.4 K 2023-03-28 05:54:59,490 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/b1bf347bbcae4069b518fe8072001dcc as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc 2023-03-28 05:54:59,495 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:54:59,497 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 87940ac43ab7a9d87409f4d6e787bb07 in 897ms, sequenceid=13, compaction requested=true 2023-03-28 05:54:59,497 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:54:59,497 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:54:59,498 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:54:59,869 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328fd5fb270d04049e8a79f20fc503d60a0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328fd5fb270d04049e8a79f20fc503d60a0 2023-03-28 05:55:00,243 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:55:00,281 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/bf4cc82571024abba5a4b444016a5069 2023-03-28 05:55:00,286 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/1ae98139d3de44de8106f41a0a91af94 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94 2023-03-28 05:55:00,291 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94, entries=4, sequenceid=13, filesize=5.4 K 2023-03-28 05:55:00,291 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/bf4cc82571024abba5a4b444016a5069 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069 2023-03-28 05:55:00,297 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:55:00,298 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f2b46b886f1b7cf3ce6017631b923841 in 1698ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:00,298 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:00,298 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-28 05:55:00,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-28 05:55:00,300 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,300 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:00,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:00,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:00,301 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,301 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:00,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:00,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:00,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:00,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-28 05:55:00,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4484bd2f[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:00,302 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-28 05:55:00,302 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,304 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-28 05:55:00,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-28 05:55:00,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:00,304 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,304 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:00,306 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,306 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-28 05:55:00,306 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:00,306 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-28 05:55:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:00,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:00,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:00,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:00,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:00,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:00,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-28 05:55:00,309 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-28 05:55:00,309 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:00,309 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:00,309 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-28 05:55:00,309 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:00,319 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,319 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,319 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:00,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:00,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:00,320 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:00,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:00,322 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:00,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:00,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-28 05:55:00,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:00,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:00,324 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:00,324 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:00,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:00,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-28 05:55:00,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:00,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:00,424 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:00,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:00,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:00,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:00,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:00,429 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:00,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:00,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-28 05:55:00,432 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-28 05:55:00,432 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:00,432 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-28 05:55:00,432 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-28 05:55:00,432 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,432 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:00,434 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:00,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:00,434 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,435 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:00,435 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:00,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:00,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:00,436 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-28 05:55:00,436 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-28 05:55:00,437 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-28 05:55:00,437 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-28 05:55:00,437 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:00,437 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-28 05:55:00,437 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:00,437 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. started... 2023-03-28 05:55:00,437 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 87940ac43ab7a9d87409f4d6e787bb07 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:00,437 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:00,438 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. started... 2023-03-28 05:55:00,438 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f2b46b886f1b7cf3ce6017631b923841 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:00,438 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:00,438 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:00,438 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. started... 2023-03-28 05:55:00,439 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing df36b35bd32c0c4727983225bdf25a02 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:00,496 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc 2023-03-28 05:55:00,506 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/fcb5518b3b7b4a10bf9b0076f2b47182 2023-03-28 05:55:00,886 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e 2023-03-28 05:55:00,896 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b 2023-03-28 05:55:00,930 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328a9d1eb09407448d688634bfa31086091 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328a9d1eb09407448d688634bfa31086091 2023-03-28 05:55:00,935 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/328e6331386b47a4b9a6d403da8c9e11 2023-03-28 05:55:00,939 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/fcb5518b3b7b4a10bf9b0076f2b47182 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182 2023-03-28 05:55:00,942 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182, entries=4, sequenceid=17, filesize=5.4 K 2023-03-28 05:55:00,943 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/328e6331386b47a4b9a6d403da8c9e11 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11 2023-03-28 05:55:00,947 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:00,948 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for df36b35bd32c0c4727983225bdf25a02 in 509ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:00,948 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:00,948 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:00,948 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:01,292 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/494dc8d9216f48f0b70ae7d33fbc5dff 2023-03-28 05:55:01,315 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f 2023-03-28 05:55:01,321 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328123b30b121f24bf3a1986866ba56af3c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328123b30b121f24bf3a1986866ba56af3c 2023-03-28 05:55:01,330 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/446a9f79e1ad4d27846fbdecd4874093 2023-03-28 05:55:01,335 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/494dc8d9216f48f0b70ae7d33fbc5dff as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff 2023-03-28 05:55:01,335 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328674254d666c5496ea5df27f99d4118ac to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328674254d666c5496ea5df27f99d4118ac 2023-03-28 05:55:01,339 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff, entries=4, sequenceid=17, filesize=5.4 K 2023-03-28 05:55:01,340 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/446a9f79e1ad4d27846fbdecd4874093 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093 2023-03-28 05:55:01,341 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/2fbe14a668d24465809e717eb47c3852 2023-03-28 05:55:01,345 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:01,345 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f2b46b886f1b7cf3ce6017631b923841 in 907ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:01,346 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:01,346 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:01,346 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:01,346 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f 2023-03-28 05:55:01,350 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f, entries=4, sequenceid=17, filesize=5.4 K 2023-03-28 05:55:01,350 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/2fbe14a668d24465809e717eb47c3852 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852 2023-03-28 05:55:01,354 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:01,355 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 87940ac43ab7a9d87409f4d6e787bb07 in 918ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:01,355 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:01,355 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:01,355 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:01,355 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:01,355 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,355 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-28 05:55:01,355 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-28 05:55:01,361 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,361 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:01,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:01,361 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,362 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:01,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:01,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:01,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:01,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:01,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-28 05:55:01,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b263383[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:01,363 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-28 05:55:01,363 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,365 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-28 05:55:01,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-28 05:55:01,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:01,365 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,365 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-28 05:55:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:01,366 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-28 05:55:01,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:01,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:01,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:01,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:01,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:01,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:01,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-28 05:55:01,369 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-28 05:55:01,369 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:01,369 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:01,370 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-28 05:55:01,370 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:01,373 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:01,373 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:01,373 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:01,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:01,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:01,374 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:01,375 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,378 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:01,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:01,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:01,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,378 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-28 05:55:01,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:01,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:01,378 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:01,379 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:01,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-28 05:55:01,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:01,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:01,379 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:01,379 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:01,379 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:01,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:01,479 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:01,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:01,492 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-28 05:55:01,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679982901492 (current time:1679982901492). 2023-03-28 05:55:01,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-28 05:55:01,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] zookeeper.ReadOnlyZKClient(139): Connect 0x795389ea to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:55:01,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f59b7e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:55:01,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:55:01,508 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44724, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:55:01,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x795389ea to 127.0.0.1:58236 2023-03-28 05:55:01,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:01,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-28 05:55:01,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-28 05:55:01,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-28 05:55:01,521 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-28 05:55:01,521 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679983501521 2023-03-28 05:55:01,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-28 05:55:01,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1679982901481 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-28 05:55:01,523 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-28 05:55:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-28 05:55:01,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-03-28 05:55:01,524 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-28 05:55:01,525 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1679983501525 2023-03-28 05:55:01,528 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:01,528 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-28 05:55:01,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1679982901481 2023-03-28 05:55:01,548 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1679982901481' 2023-03-28 05:55:01,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-28 05:55:01,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1679982901481' starting 'acquire' 2023-03-28 05:55:01,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1679982901481', kicking off acquire phase on members. 2023-03-28 05:55:01,612 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:01,613 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1679982901481 2023-03-28 05:55:01,614 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,614 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-28 05:55:01,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-28 05:55:01,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-28 05:55:01,615 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,615 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:01,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1679982901481 2023-03-28 05:55:01,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:01,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-28 05:55:01,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1679982901481 2023-03-28 05:55:01,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1679982901481 from table testCompactionWithHFileLink type FLUSH 2023-03-28 05:55:01,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1679982901481 2023-03-28 05:55:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1679982901481' with timeout 300000ms 2023-03-28 05:55:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-28 05:55:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1679982901481' starting 'acquire' stage 2023-03-28 05:55:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1679982901481' locally acquired 2023-03-28 05:55:01,618 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (snaptb-1679982901481) in zk 2023-03-28 05:55:01,620 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,620 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:01,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:01,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-28 05:55:01,620 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:01,620 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1679982901481' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:01,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679982901481 2023-03-28 05:55:01,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:01,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'snaptb-1679982901481' on coordinator 2023-03-28 05:55:01,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70afbd61[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:01,622 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1679982901481' starting 'in-barrier' execution. 2023-03-28 05:55:01,622 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:01,623 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:01,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:01,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:01,623 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1679982901481' received 'reached' from coordinator. 2023-03-28 05:55:01,624 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:01,624 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:01,624 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:01,624 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:01,625 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-28 05:55:01,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. started... 2023-03-28 05:55:01,625 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-28 05:55:01,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:01,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:01,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. started... 2023-03-28 05:55:01,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:01,625 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. started... 2023-03-28 05:55:01,626 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:01,626 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.' region-info for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,626 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.' region-info for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,626 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.' region-info for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,629 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:01,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:01,633 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-28 05:55:01,633 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-28 05:55:01,633 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-28 05:55:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:01,633 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-28 05:55:01,637 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f] hfiles 2023-03-28 05:55:01,637 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff] hfiles 2023-03-28 05:55:01,637 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182] hfiles 2023-03-28 05:55:01,637 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,637 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,638 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093] hfiles 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,642 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852] hfiles 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11] hfiles 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11 for snapshot=snaptb-1679982901481 2023-03-28 05:55:01,655 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. completed. 2023-03-28 05:55:01,655 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:01,655 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-28 05:55:01,833 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:01,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:01,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:01,835 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-28 05:55:02,053 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. completed. 2023-03-28 05:55:02,053 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:02,053 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-28 05:55:02,054 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. completed. 2023-03-28 05:55:02,054 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-28 05:55:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-28 05:55:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1679982901481' locally completed 2023-03-28 05:55:02,054 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1679982901481' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:02,056 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,056 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1679982901481' has notified controller of completion 2023-03-28 05:55:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-28 05:55:02,056 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:02,056 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1679982901481' completed. 2023-03-28 05:55:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:02,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679982901481 2023-03-28 05:55:02,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:02,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679982901481 2023-03-28 05:55:02,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1679982901481' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:02,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'snaptb-1679982901481', counting down latch. Waiting for 0 more 2023-03-28 05:55:02,058 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1679982901481' execution completed 2023-03-28 05:55:02,058 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:02,058 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:02,058 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1679982901481 2023-03-28 05:55:02,058 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1679982901481including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-28 05:55:02,061 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:02,061 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-28 05:55:02,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:02,061 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-28 05:55:02,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-28 05:55:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-28 05:55:02,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:02,061 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679982901481 2023-03-28 05:55:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:02,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679982901481 2023-03-28 05:55:02,063 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:02,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679982901481 2023-03-28 05:55:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,065 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:02,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1679982901481 because node does not exist (not an error) 2023-03-28 05:55:02,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1679982901481 2023-03-28 05:55:02,065 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-28 05:55:02,066 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-28 05:55:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-28 05:55:02,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-28 05:55:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-28 05:55:02,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1679982901481 2023-03-28 05:55:02,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-28 05:55:02,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-28 05:55:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-28 05:55:02,067 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,067 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679982901481 2023-03-28 05:55:02,067 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679982901481 2023-03-28 05:55:02,067 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679982901481/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,067 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:02,067 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679982901481 2023-03-28 05:55:02,067 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679982901481 2023-03-28 05:55:02,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962] mob files 2023-03-28 05:55:02,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e 2023-03-28 05:55:02,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303280a28bc7508b84d568254ae381787f24f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328674254d666c5496ea5df27f99d4118ac, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328b9dbe0d14e1f40c59f5a9e4f7ef4ecf6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328cceb58ac27ee4c899b1d43bfcdc2bb50, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032822c1de3ce8ab4d3bbccd0bc98f49929c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032870e0acb3f55b4b0da260c20877556448, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328a9d1eb09407448d688634bfa31086091, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328d3521bb0c2a14c1295ab27bff53eb132, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328123b30b121f24bf3a1986866ba56af3c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303281479028a6a274c0da0221fd545a3f1c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303289166684d8c594f91960bbf1538338257, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328fd5fb270d04049e8a79f20fc503d60a0] mob files 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303280a28bc7508b84d568254ae381787f24f 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328674254d666c5496ea5df27f99d4118ac 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328b9dbe0d14e1f40c59f5a9e4f7ef4ecf6 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328cceb58ac27ee4c899b1d43bfcdc2bb50 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032822c1de3ce8ab4d3bbccd0bc98f49929c 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032870e0acb3f55b4b0da260c20877556448 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328a9d1eb09407448d688634bfa31086091 2023-03-28 05:55:02,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328d3521bb0c2a14c1295ab27bff53eb132 2023-03-28 05:55:02,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328123b30b121f24bf3a1986866ba56af3c 2023-03-28 05:55:02,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303281479028a6a274c0da0221fd545a3f1c0 2023-03-28 05:55:02,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303289166684d8c594f91960bbf1538338257 2023-03-28 05:55:02,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328fd5fb270d04049e8a79f20fc503d60a0 2023-03-28 05:55:02,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1679982901481 2023-03-28 05:55:02,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/snaptb-1679982901481 2023-03-28 05:55:02,137 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:02,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:02,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:02,139 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-28 05:55:02,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/snaptb-1679982901481 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/snaptb-1679982901481 2023-03-28 05:55:02,203 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1679982901481 of table testCompactionWithHFileLink completed 2023-03-28 05:55:02,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/snaptb-1679982901481 2023-03-28 05:55:02,203 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/snaptb-1679982901481 2023-03-28 05:55:02,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1679982901481 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679982901522Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1679982902081 (+559 ms)Consolidate snapshot: snaptb-1679982901481 at 1679982902081Loading Region manifests for snaptb-1679982901481 at 1679982902081Writing data manifest for snaptb-1679982901481 at 1679982902094 (+13 ms)Verifying snapshot: snaptb-1679982901481 at 1679982902120 (+26 ms)Snapshot snaptb-1679982901481 of table testCompactionWithHFileLink completed at 1679982902203 (+83 ms) 2023-03-28 05:55:02,205 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-28 05:55:02,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 682 msec 2023-03-28 05:55:02,639 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:02,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:02,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-28 05:55:02,680 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:02,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:02,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-28 05:55:02,682 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-28 05:55:02,682 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:02,682 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-28 05:55:02,682 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-28 05:55:02,682 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:02,683 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:02,684 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:02,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:02,684 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:02,684 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:02,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:02,684 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:02,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:02,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-28 05:55:02,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-28 05:55:02,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-28 05:55:02,685 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-28 05:55:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-28 05:55:02,686 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:02,686 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. started... 2023-03-28 05:55:02,686 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:02,686 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:02,686 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. started... 2023-03-28 05:55:02,686 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:02,686 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 87940ac43ab7a9d87409f4d6e787bb07 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:02,686 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing f2b46b886f1b7cf3ce6017631b923841 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:02,686 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. started... 2023-03-28 05:55:02,687 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing df36b35bd32c0c4727983225bdf25a02 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:03,133 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/2f8624af201e487f89ccb8a62fb486a0 2023-03-28 05:55:03,137 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f8624af201e487f89ccb8a62fb486a0 2023-03-28 05:55:03,528 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/9ec829f6e83f448d9295e13a4a2121df 2023-03-28 05:55:03,529 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/dbd83a9c6d5e429e8763ec007b6f06ae 2023-03-28 05:55:03,532 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ec829f6e83f448d9295e13a4a2121df 2023-03-28 05:55:03,532 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbd83a9c6d5e429e8763ec007b6f06ae 2023-03-28 05:55:03,551 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/d3eca73d899040e8b3b42cad8bb43784 2023-03-28 05:55:03,554 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3eca73d899040e8b3b42cad8bb43784 2023-03-28 05:55:03,555 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/2f8624af201e487f89ccb8a62fb486a0 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/2f8624af201e487f89ccb8a62fb486a0 2023-03-28 05:55:03,558 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f8624af201e487f89ccb8a62fb486a0 2023-03-28 05:55:03,559 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/2f8624af201e487f89ccb8a62fb486a0, entries=3, sequenceid=24, filesize=5.0 K 2023-03-28 05:55:03,559 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/d3eca73d899040e8b3b42cad8bb43784 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/d3eca73d899040e8b3b42cad8bb43784 2023-03-28 05:55:03,563 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3eca73d899040e8b3b42cad8bb43784 2023-03-28 05:55:03,563 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/d3eca73d899040e8b3b42cad8bb43784, entries=1, sequenceid=24, filesize=5.0 K 2023-03-28 05:55:03,564 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f2b46b886f1b7cf3ce6017631b923841 in 878ms, sequenceid=24, compaction requested=true 2023-03-28 05:55:03,564 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:03,564 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:03,564 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:04,347 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/37135857b1914c2f8b14f23a0426a91c 2023-03-28 05:55:04,349 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/fbc110c959514b8b8fae1e0b32ecf6e4 2023-03-28 05:55:04,351 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37135857b1914c2f8b14f23a0426a91c 2023-03-28 05:55:04,352 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/dbd83a9c6d5e429e8763ec007b6f06ae as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/dbd83a9c6d5e429e8763ec007b6f06ae 2023-03-28 05:55:04,353 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbc110c959514b8b8fae1e0b32ecf6e4 2023-03-28 05:55:04,353 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/9ec829f6e83f448d9295e13a4a2121df as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/9ec829f6e83f448d9295e13a4a2121df 2023-03-28 05:55:04,355 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbd83a9c6d5e429e8763ec007b6f06ae 2023-03-28 05:55:04,355 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/dbd83a9c6d5e429e8763ec007b6f06ae, entries=3, sequenceid=24, filesize=5.0 K 2023-03-28 05:55:04,358 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/37135857b1914c2f8b14f23a0426a91c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/37135857b1914c2f8b14f23a0426a91c 2023-03-28 05:55:04,358 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ec829f6e83f448d9295e13a4a2121df 2023-03-28 05:55:04,359 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/9ec829f6e83f448d9295e13a4a2121df, entries=3, sequenceid=24, filesize=5.0 K 2023-03-28 05:55:04,359 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/fbc110c959514b8b8fae1e0b32ecf6e4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/fbc110c959514b8b8fae1e0b32ecf6e4 2023-03-28 05:55:04,362 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37135857b1914c2f8b14f23a0426a91c 2023-03-28 05:55:04,362 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/37135857b1914c2f8b14f23a0426a91c, entries=1, sequenceid=24, filesize=5.0 K 2023-03-28 05:55:04,362 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for df36b35bd32c0c4727983225bdf25a02 in 1676ms, sequenceid=24, compaction requested=true 2023-03-28 05:55:04,362 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:04,362 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:04,362 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:04,363 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbc110c959514b8b8fae1e0b32ecf6e4 2023-03-28 05:55:04,363 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/fbc110c959514b8b8fae1e0b32ecf6e4, entries=1, sequenceid=24, filesize=5.0 K 2023-03-28 05:55:04,363 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 87940ac43ab7a9d87409f4d6e787bb07 in 1677ms, sequenceid=24, compaction requested=true 2023-03-28 05:55:04,363 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:04,363 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:04,364 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:04,364 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:04,364 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,364 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-28 05:55:04,364 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-28 05:55:04,365 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:04,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:04,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-28 05:55:04,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@718bb93b[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:04,367 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-28 05:55:04,367 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,369 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,369 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-28 05:55:04,369 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-28 05:55:04,369 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:04,369 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,369 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:04,377 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-28 05:55:04,377 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:04,377 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,377 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-28 05:55:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:04,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:04,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:04,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-28 05:55:04,379 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-28 05:55:04,379 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:04,379 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:04,379 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-28 05:55:04,380 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:04,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:04,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:04,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:04,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:04,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:04,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:04,381 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:04,382 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-28 05:55:04,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:04,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,385 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:04,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-28 05:55:04,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:04,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:04,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:04,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:04,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:04,385 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-28 05:55:04,386 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:04,386 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:04,386 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:04,386 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:04,386 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-28 05:55:04,386 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-28 05:55:04,486 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:04,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:04,487 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:04,487 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 87940ac43ab7a9d87409f4d6e787bb07/family1 is initiating major compaction (all files) 2023-03-28 05:55:04,488 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:04,488 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:04,488 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 87940ac43ab7a9d87409f4d6e787bb07/family1 in testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:04,489 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/9ec829f6e83f448d9295e13a4a2121df] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp, totalSize=26.7 K 2023-03-28 05:55:04,489 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 86421ecd2cee47128227a8bf593757a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895628 2023-03-28 05:55:04,489 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting a60410d863dc4e7a9907588fee122dc7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:04,490 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting bb9d12c1ef55466984d68b5fbebefbd2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:04,490 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting f3a6fc1bdcb04e2fa83189b9eeb9138f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:04,491 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 9ec829f6e83f448d9295e13a4a2121df, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-28 05:55:04,503 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 87940ac43ab7a9d87409f4d6e787bb07#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:04,910 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328a509dd5f642f439f90215877cb0222d0_del 2023-03-28 05:55:04,911 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328a509dd5f642f439f90215877cb0222d0_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328a509dd5f642f439f90215877cb0222d0_del 2023-03-28 05:55:05,323 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8f42b2ce9164bbaaccdb318238f3683 2023-03-28 05:55:05,324 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/a8f42b2ce9164bbaaccdb318238f3683 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a8f42b2ce9164bbaaccdb318238f3683 2023-03-28 05:55:05,327 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8f42b2ce9164bbaaccdb318238f3683 2023-03-28 05:55:05,328 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 87940ac43ab7a9d87409f4d6e787bb07/family1 of 87940ac43ab7a9d87409f4d6e787bb07 into a8f42b2ce9164bbaaccdb318238f3683(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:05,328 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:05,328 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:05,328 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 87940ac43ab7a9d87409f4d6e787bb07/family2 is initiating major compaction (all files) 2023-03-28 05:55:05,328 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:05,328 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:05,329 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 87940ac43ab7a9d87409f4d6e787bb07/family2 in testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:05,329 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/fbc110c959514b8b8fae1e0b32ecf6e4] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp, totalSize=25.4 K 2023-03-28 05:55:05,330 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 2b62ba8baa164e8b9710a82d996d5382, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895628 2023-03-28 05:55:05,330 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 6aee4f92673744a79774b113c267a183, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:05,330 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting b1bf347bbcae4069b518fe8072001dcc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:05,331 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 2fbe14a668d24465809e717eb47c3852, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:05,331 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting fbc110c959514b8b8fae1e0b32ecf6e4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-28 05:55:05,341 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 87940ac43ab7a9d87409f4d6e787bb07#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:05,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/9ec829f6e83f448d9295e13a4a2121df] to archive 2023-03-28 05:55:05,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:05,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/86421ecd2cee47128227a8bf593757a3 2023-03-28 05:55:05,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a60410d863dc4e7a9907588fee122dc7 2023-03-28 05:55:05,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/bb9d12c1ef55466984d68b5fbebefbd2 2023-03-28 05:55:05,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/f3a6fc1bdcb04e2fa83189b9eeb9138f 2023-03-28 05:55:05,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/9ec829f6e83f448d9295e13a4a2121df to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/9ec829f6e83f448d9295e13a4a2121df 2023-03-28 05:55:05,752 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328d891c3c3eb774901bea5443a88e1bc7d_del 2023-03-28 05:55:05,753 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328d891c3c3eb774901bea5443a88e1bc7d_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328d891c3c3eb774901bea5443a88e1bc7d_del 2023-03-28 05:55:06,565 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a134c5ba920746c6b715c7042a6a682f 2023-03-28 05:55:06,565 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/a134c5ba920746c6b715c7042a6a682f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/a134c5ba920746c6b715c7042a6a682f 2023-03-28 05:55:06,568 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a134c5ba920746c6b715c7042a6a682f 2023-03-28 05:55:06,569 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 87940ac43ab7a9d87409f4d6e787bb07/family2 of 87940ac43ab7a9d87409f4d6e787bb07 into a134c5ba920746c6b715c7042a6a682f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:55:06,569 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:06,569 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:06,569 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): f2b46b886f1b7cf3ce6017631b923841/family1 is initiating major compaction (all files) 2023-03-28 05:55:06,569 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:06,570 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:06,570 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of f2b46b886f1b7cf3ce6017631b923841/family1 in testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:06,570 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/2f8624af201e487f89ccb8a62fb486a0] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp, totalSize=26.7 K 2023-03-28 05:55:06,570 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 9cd2be624432451281d8a112467029bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895627 2023-03-28 05:55:06,570 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 8b8130b1a3314a40b2c60e46379e7108, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897459 2023-03-28 05:55:06,571 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 1ae98139d3de44de8106f41a0a91af94, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898577 2023-03-28 05:55:06,571 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 494dc8d9216f48f0b70ae7d33fbc5dff, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:06,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/fbc110c959514b8b8fae1e0b32ecf6e4] to archive 2023-03-28 05:55:06,571 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 2f8624af201e487f89ccb8a62fb486a0, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-28 05:55:06,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:06,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2b62ba8baa164e8b9710a82d996d5382 2023-03-28 05:55:06,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/6aee4f92673744a79774b113c267a183 2023-03-28 05:55:06,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/b1bf347bbcae4069b518fe8072001dcc 2023-03-28 05:55:06,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/2fbe14a668d24465809e717eb47c3852 2023-03-28 05:55:06,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/fbc110c959514b8b8fae1e0b32ecf6e4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/fbc110c959514b8b8fae1e0b32ecf6e4 2023-03-28 05:55:06,582 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): f2b46b886f1b7cf3ce6017631b923841#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:06,998 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303280ed6264ee4e446be84b057efe188f5ce_del 2023-03-28 05:55:06,998 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303280ed6264ee4e446be84b057efe188f5ce_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303280ed6264ee4e446be84b057efe188f5ce_del 2023-03-28 05:55:07,812 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37c6bca8891743ba9d4fb099aef58c84 2023-03-28 05:55:07,812 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/37c6bca8891743ba9d4fb099aef58c84 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/37c6bca8891743ba9d4fb099aef58c84 2023-03-28 05:55:07,816 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37c6bca8891743ba9d4fb099aef58c84 2023-03-28 05:55:07,816 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f2b46b886f1b7cf3ce6017631b923841/family1 of f2b46b886f1b7cf3ce6017631b923841 into 37c6bca8891743ba9d4fb099aef58c84(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:55:07,817 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:07,817 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:07,817 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): f2b46b886f1b7cf3ce6017631b923841/family2 is initiating major compaction (all files) 2023-03-28 05:55:07,817 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:07,817 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:07,817 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of f2b46b886f1b7cf3ce6017631b923841/family2 in testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:07,817 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/d3eca73d899040e8b3b42cad8bb43784] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp, totalSize=25.4 K 2023-03-28 05:55:07,817 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting b37a2350ac8043c5a92b7670a9bda3b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895627 2023-03-28 05:55:07,818 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting e7497dd47f5644ccbdedf071442194d3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897459 2023-03-28 05:55:07,818 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting bf4cc82571024abba5a4b444016a5069, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898577 2023-03-28 05:55:07,818 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 446a9f79e1ad4d27846fbdecd4874093, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:07,818 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting d3eca73d899040e8b3b42cad8bb43784, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-28 05:55:07,836 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): f2b46b886f1b7cf3ce6017631b923841#family2#compaction#111 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:07,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/2f8624af201e487f89ccb8a62fb486a0] to archive 2023-03-28 05:55:07,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:07,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/9cd2be624432451281d8a112467029bb 2023-03-28 05:55:07,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/8b8130b1a3314a40b2c60e46379e7108 2023-03-28 05:55:07,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/1ae98139d3de44de8106f41a0a91af94 2023-03-28 05:55:07,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/494dc8d9216f48f0b70ae7d33fbc5dff 2023-03-28 05:55:07,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/2f8624af201e487f89ccb8a62fb486a0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/2f8624af201e487f89ccb8a62fb486a0 2023-03-28 05:55:08,244 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230328d255685e9e2448b6a0f9547caaefef10_del 2023-03-28 05:55:08,244 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328d255685e9e2448b6a0f9547caaefef10_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328d255685e9e2448b6a0f9547caaefef10_del 2023-03-28 05:55:09,057 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27065405adee45178cd7d46f1f0ac8e0 2023-03-28 05:55:09,058 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/27065405adee45178cd7d46f1f0ac8e0 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/27065405adee45178cd7d46f1f0ac8e0 2023-03-28 05:55:09,061 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27065405adee45178cd7d46f1f0ac8e0 2023-03-28 05:55:09,062 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f2b46b886f1b7cf3ce6017631b923841/family2 of f2b46b886f1b7cf3ce6017631b923841 into 27065405adee45178cd7d46f1f0ac8e0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:55:09,062 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:09,062 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:09,062 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): df36b35bd32c0c4727983225bdf25a02/family1 is initiating major compaction (all files) 2023-03-28 05:55:09,062 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:09,063 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:09,063 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of df36b35bd32c0c4727983225bdf25a02/family1 in testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:09,063 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/dbd83a9c6d5e429e8763ec007b6f06ae] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp, totalSize=26.7 K 2023-03-28 05:55:09,064 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 5146126471d645c8908596ebb9746f58, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895629 2023-03-28 05:55:09,064 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 345031e3a72c44f7a4ca76b4f80d6012, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:09,064 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting b544dffd423f459bbd078c742b997656, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:09,065 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting fcb5518b3b7b4a10bf9b0076f2b47182, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:09,065 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting dbd83a9c6d5e429e8763ec007b6f06ae, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-28 05:55:09,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/d3eca73d899040e8b3b42cad8bb43784] to archive 2023-03-28 05:55:09,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:09,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/b37a2350ac8043c5a92b7670a9bda3b2 2023-03-28 05:55:09,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/e7497dd47f5644ccbdedf071442194d3 2023-03-28 05:55:09,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/bf4cc82571024abba5a4b444016a5069 2023-03-28 05:55:09,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/446a9f79e1ad4d27846fbdecd4874093 2023-03-28 05:55:09,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/d3eca73d899040e8b3b42cad8bb43784 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/d3eca73d899040e8b3b42cad8bb43784 2023-03-28 05:55:09,076 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): df36b35bd32c0c4727983225bdf25a02#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:09,484 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303282dff7cf83b494710b89f44330d55216a_del 2023-03-28 05:55:09,485 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303282dff7cf83b494710b89f44330d55216a_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303282dff7cf83b494710b89f44330d55216a_del 2023-03-28 05:55:10,298 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5067fa6780ce4871b54e4ab21b4b7faf 2023-03-28 05:55:10,299 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/5067fa6780ce4871b54e4ab21b4b7faf as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5067fa6780ce4871b54e4ab21b4b7faf 2023-03-28 05:55:10,302 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5067fa6780ce4871b54e4ab21b4b7faf 2023-03-28 05:55:10,303 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in df36b35bd32c0c4727983225bdf25a02/family1 of df36b35bd32c0c4727983225bdf25a02 into 5067fa6780ce4871b54e4ab21b4b7faf(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:55:10,303 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:10,304 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:10,304 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): df36b35bd32c0c4727983225bdf25a02/family2 is initiating major compaction (all files) 2023-03-28 05:55:10,304 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:10,304 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:10,305 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of df36b35bd32c0c4727983225bdf25a02/family2 in testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:10,305 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/37135857b1914c2f8b14f23a0426a91c] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp, totalSize=25.4 K 2023-03-28 05:55:10,305 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 5396d89c753848b48bd06195dce49392, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895629 2023-03-28 05:55:10,305 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 767fecffbc63478b9f4fd5eaf0575c77, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:10,306 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting cded5e69144f441ca8d26234d49134c0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:10,306 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 328e6331386b47a4b9a6d403da8c9e11, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:10,306 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 37135857b1914c2f8b14f23a0426a91c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-28 05:55:10,316 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): df36b35bd32c0c4727983225bdf25a02#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:10,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/dbd83a9c6d5e429e8763ec007b6f06ae] to archive 2023-03-28 05:55:10,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:10,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5146126471d645c8908596ebb9746f58 2023-03-28 05:55:10,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/345031e3a72c44f7a4ca76b4f80d6012 2023-03-28 05:55:10,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/b544dffd423f459bbd078c742b997656 2023-03-28 05:55:10,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fcb5518b3b7b4a10bf9b0076f2b47182 2023-03-28 05:55:10,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/dbd83a9c6d5e429e8763ec007b6f06ae to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/dbd83a9c6d5e429e8763ec007b6f06ae 2023-03-28 05:55:10,724 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023032824423e1bb7b64f5eb5ff5b6a22b33358_del 2023-03-28 05:55:10,724 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032824423e1bb7b64f5eb5ff5b6a22b33358_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032824423e1bb7b64f5eb5ff5b6a22b33358_del 2023-03-28 05:55:11,537 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c72dad1930074ef0865d0d66206459a3 2023-03-28 05:55:11,538 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/c72dad1930074ef0865d0d66206459a3 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/c72dad1930074ef0865d0d66206459a3 2023-03-28 05:55:11,541 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c72dad1930074ef0865d0d66206459a3 2023-03-28 05:55:11,542 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in df36b35bd32c0c4727983225bdf25a02/family2 of df36b35bd32c0c4727983225bdf25a02 into c72dad1930074ef0865d0d66206459a3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:55:11,542 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:11,546 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:11,550 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:11,554 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:11,554 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:11,559 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-28 05:55:11,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/37135857b1914c2f8b14f23a0426a91c] to archive 2023-03-28 05:55:11,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:11,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/5396d89c753848b48bd06195dce49392 2023-03-28 05:55:11,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/767fecffbc63478b9f4fd5eaf0575c77 2023-03-28 05:55:11,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/cded5e69144f441ca8d26234d49134c0 2023-03-28 05:55:11,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/328e6331386b47a4b9a6d403da8c9e11 2023-03-28 05:55:11,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/37135857b1914c2f8b14f23a0426a91c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/37135857b1914c2f8b14f23a0426a91c 2023-03-28 05:55:11,592 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-28 05:55:11,595 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303280ed6264ee4e446be84b057efe188f5ce_del 2023-03-28 05:55:11,598 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328a509dd5f642f439f90215877cb0222d0_del 2023-03-28 05:55:11,601 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303282dff7cf83b494710b89f44330d55216a_del 2023-03-28 05:55:11,601 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:11,602 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(139): Connect 0x79e2a56f to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:55:11,607 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d029a08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:55:11,607 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:11,608 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:11,608 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:12,454 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032801a72dffb63040219270474aaa306cc5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032801a72dffb63040219270474aaa306cc5 2023-03-28 05:55:12,455 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032882a65d9911724072bd6f3cd1eba515a4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032882a65d9911724072bd6f3cd1eba515a4 2023-03-28 05:55:12,456 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303288c5830715790457f804950cf8beb83fd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303288c5830715790457f804950cf8beb83fd 2023-03-28 05:55:12,456 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:12,456 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:12,456 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:12,474 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:55:12,478 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:55:12,485 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:55:12,487 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42894, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:55:12,499 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/7d8cc330f6a8490685e3d35110019ef2 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-28 05:55:12,499 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/00fefceca21545d8a23954d477d76500 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-28 05:55:12,501 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/7d8cc330f6a8490685e3d35110019ef2}] 2023-03-28 05:55:12,501 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/00fefceca21545d8a23954d477d76500}] 2023-03-28 05:55:12,503 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/53e16d63889e4b58a08856a841c4714e first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-28 05:55:12,504 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/53e16d63889e4b58a08856a841c4714e}] 2023-03-28 05:55:12,506 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/7d8cc330f6a8490685e3d35110019ef2 for inclusion in f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:55:12,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/00fefceca21545d8a23954d477d76500 for inclusion in df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:55:12,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/53e16d63889e4b58a08856a841c4714e for inclusion in 87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:55:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-28 05:55:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-28 05:55:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-28 05:55:12,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-28 05:55:12,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:12,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-28 05:55:12,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last=1 2023-03-28 05:55:12,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:12,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/53e16d63889e4b58a08856a841c4714e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__ntl4nuu5hv45fr6eg7njrivn50eppca1lvj11q4ul884t3to1updq8640gff0som/family1/53e16d63889e4b58a08856a841c4714e 2023-03-28 05:55:12,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/7d8cc330f6a8490685e3d35110019ef2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__beb3q23jhbinahuoqkii9b5jdp7her61manqa0a1g5vcjjuqcjk5312m0eitgii4/family1/7d8cc330f6a8490685e3d35110019ef2 2023-03-28 05:55:12,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/00fefceca21545d8a23954d477d76500 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__jd75g2odrmvfhqinb61dadijm226barv3p4aor43vmmj4n2uc8qfm762509qu4kl/family1/00fefceca21545d8a23954d477d76500 2023-03-28 05:55:12,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__ntl4nuu5hv45fr6eg7njrivn50eppca1lvj11q4ul884t3to1updq8640gff0som/family1/53e16d63889e4b58a08856a841c4714e as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_ 2023-03-28 05:55:12,512 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__ntl4nuu5hv45fr6eg7njrivn50eppca1lvj11q4ul884t3to1updq8640gff0som/family1/53e16d63889e4b58a08856a841c4714e into 87940ac43ab7a9d87409f4d6e787bb07/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_ - updating store file list. 2023-03-28 05:55:12,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__beb3q23jhbinahuoqkii9b5jdp7her61manqa0a1g5vcjjuqcjk5312m0eitgii4/family1/7d8cc330f6a8490685e3d35110019ef2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_ 2023-03-28 05:55:12,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__jd75g2odrmvfhqinb61dadijm226barv3p4aor43vmmj4n2uc8qfm762509qu4kl/family1/00fefceca21545d8a23954d477d76500 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_ 2023-03-28 05:55:12,513 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__beb3q23jhbinahuoqkii9b5jdp7her61manqa0a1g5vcjjuqcjk5312m0eitgii4/family1/7d8cc330f6a8490685e3d35110019ef2 into f2b46b886f1b7cf3ce6017631b923841/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_ - updating store file list. 2023-03-28 05:55:12,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__jd75g2odrmvfhqinb61dadijm226barv3p4aor43vmmj4n2uc8qfm762509qu4kl/family1/00fefceca21545d8a23954d477d76500 into df36b35bd32c0c4727983225bdf25a02/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_ - updating store file list. 2023-03-28 05:55:12,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_ into 87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:55:12,516 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__ntl4nuu5hv45fr6eg7njrivn50eppca1lvj11q4ul884t3to1updq8640gff0som/family1/53e16d63889e4b58a08856a841c4714e into 87940ac43ab7a9d87409f4d6e787bb07/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_) 2023-03-28 05:55:12,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__ntl4nuu5hv45fr6eg7njrivn50eppca1lvj11q4ul884t3to1updq8640gff0som/family1/53e16d63889e4b58a08856a841c4714e 2023-03-28 05:55:12,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_ into df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:55:12,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__jd75g2odrmvfhqinb61dadijm226barv3p4aor43vmmj4n2uc8qfm762509qu4kl/family1/00fefceca21545d8a23954d477d76500 into df36b35bd32c0c4727983225bdf25a02/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_) 2023-03-28 05:55:12,517 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_ into f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:55:12,517 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__beb3q23jhbinahuoqkii9b5jdp7her61manqa0a1g5vcjjuqcjk5312m0eitgii4/family1/7d8cc330f6a8490685e3d35110019ef2 into f2b46b886f1b7cf3ce6017631b923841/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_) 2023-03-28 05:55:12,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__jd75g2odrmvfhqinb61dadijm226barv3p4aor43vmmj4n2uc8qfm762509qu4kl/family1/00fefceca21545d8a23954d477d76500 2023-03-28 05:55:12,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__beb3q23jhbinahuoqkii9b5jdp7her61manqa0a1g5vcjjuqcjk5312m0eitgii4/family1/7d8cc330f6a8490685e3d35110019ef2 2023-03-28 05:55:12,519 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:12,519 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:12,519 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:12,520 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:12,520 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:12,520 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:12,522 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b 2023-03-28 05:55:12,522 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a 2023-03-28 05:55:12,522 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 2023-03-28 05:55:12,523 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 2023-03-28 05:55:12,524 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f 2023-03-28 05:55:12,524 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 2023-03-28 05:55:12,525 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af 2023-03-28 05:55:12,525 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc 2023-03-28 05:55:12,526 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e 2023-03-28 05:55:12,526 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e 2023-03-28 05:55:12,526 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-28 05:55:12,526 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328' 2023-03-28 05:55:12,526 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 2023-03-28 05:55:12,527 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-28 05:55:12,527 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328' 2023-03-28 05:55:12,527 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 2023-03-28 05:55:12,527 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-28 05:55:12,527 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:12,527 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:12,527 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328' 2023-03-28 05:55:12,528 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:12,528 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:12,528 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:12,528 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303280ed6264ee4e446be84b057efe188f5ce_del] 2023-03-28 05:55:12,528 DEBUG [Listener at localhost/33463] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:12,529 DEBUG [Listener at localhost/33463] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303280ed6264ee4e446be84b057efe188f5ce_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303280ed6264ee4e446be84b057efe188f5ce_del 2023-03-28 05:55:12,530 INFO [Listener at localhost/33463] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-28 05:55:12,530 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328a509dd5f642f439f90215877cb0222d0_del] 2023-03-28 05:55:12,530 DEBUG [Listener at localhost/33463] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:12,531 DEBUG [Listener at localhost/33463] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328a509dd5f642f439f90215877cb0222d0_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328a509dd5f642f439f90215877cb0222d0_del 2023-03-28 05:55:12,531 INFO [Listener at localhost/33463] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-28 05:55:12,531 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303282dff7cf83b494710b89f44330d55216a_del] 2023-03-28 05:55:12,532 DEBUG [Listener at localhost/33463] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:12,533 DEBUG [Listener at localhost/33463] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303282dff7cf83b494710b89f44330d55216a_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303282dff7cf83b494710b89f44330d55216a_del 2023-03-28 05:55:12,533 INFO [Listener at localhost/33463] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-28 05:55:12,537 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:12,539 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:12,543 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:12,544 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:12,551 INFO [Listener at localhost/33463] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-28 05:55:12,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-03-28 05:55:12,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-28 05:55:12,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-28 05:55:12,556 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982912556"}]},"ts":"1679982912556"} 2023-03-28 05:55:12,557 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-28 05:55:12,559 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-28 05:55:12,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, UNASSIGN}] 2023-03-28 05:55:12,561 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, UNASSIGN 2023-03-28 05:55:12,561 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, UNASSIGN 2023-03-28 05:55:12,561 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, UNASSIGN 2023-03-28 05:55:12,561 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=87940ac43ab7a9d87409f4d6e787bb07, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:12,561 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=df36b35bd32c0c4727983225bdf25a02, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:12,561 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982912561"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982912561"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982912561"}]},"ts":"1679982912561"} 2023-03-28 05:55:12,561 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982912561"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982912561"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982912561"}]},"ts":"1679982912561"} 2023-03-28 05:55:12,562 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f2b46b886f1b7cf3ce6017631b923841, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:12,562 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982912562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982912562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982912562"}]},"ts":"1679982912562"} 2023-03-28 05:55:12,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 87940ac43ab7a9d87409f4d6e787bb07, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:12,563 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure df36b35bd32c0c4727983225bdf25a02, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:12,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure f2b46b886f1b7cf3ce6017631b923841, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:12,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-28 05:55:12,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:12,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing df36b35bd32c0c4727983225bdf25a02, disabling compactions & flushes 2023-03-28 05:55:12,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:12,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:12,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. after waiting 0 ms 2023-03-28 05:55:12,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:12,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-28 05:55:12,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:12,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:12,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:12,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:12,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87940ac43ab7a9d87409f4d6e787bb07, disabling compactions & flushes 2023-03-28 05:55:12,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:12,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:12,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. after waiting 0 ms 2023-03-28 05:55:12,721 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=df36b35bd32c0c4727983225bdf25a02, regionState=CLOSED 2023-03-28 05:55:12,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:12,721 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982912721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982912721"}]},"ts":"1679982912721"} 2023-03-28 05:55:12,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-03-28 05:55:12,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure df36b35bd32c0c4727983225bdf25a02, server=jenkins-hbase4.apache.org,39167,1679982818904 in 160 msec 2023-03-28 05:55:12,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, UNASSIGN in 165 msec 2023-03-28 05:55:12,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-28 05:55:12,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:12,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:12,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:12,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:12,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2b46b886f1b7cf3ce6017631b923841, disabling compactions & flushes 2023-03-28 05:55:12,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:12,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:12,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. after waiting 0 ms 2023-03-28 05:55:12,727 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=87940ac43ab7a9d87409f4d6e787bb07, regionState=CLOSED 2023-03-28 05:55:12,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:12,727 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982912727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982912727"}]},"ts":"1679982912727"} 2023-03-28 05:55:12,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-03-28 05:55:12,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 87940ac43ab7a9d87409f4d6e787bb07, server=jenkins-hbase4.apache.org,39167,1679982818904 in 166 msec 2023-03-28 05:55:12,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, UNASSIGN in 171 msec 2023-03-28 05:55:12,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-28 05:55:12,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:12,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:12,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:12,733 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f2b46b886f1b7cf3ce6017631b923841, regionState=CLOSED 2023-03-28 05:55:12,733 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982912733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982912733"}]},"ts":"1679982912733"} 2023-03-28 05:55:12,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-03-28 05:55:12,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure f2b46b886f1b7cf3ce6017631b923841, server=jenkins-hbase4.apache.org,39167,1679982818904 in 170 msec 2023-03-28 05:55:12,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-03-28 05:55:12,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, UNASSIGN in 176 msec 2023-03-28 05:55:12,736 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982912736"}]},"ts":"1679982912736"} 2023-03-28 05:55:12,737 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-28 05:55:12,739 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-28 05:55:12,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 187 msec 2023-03-28 05:55:12,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-28 05:55:12,857 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-28 05:55:12,867 INFO [Listener at localhost/33463] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:12,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-28 05:55:12,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679982912868 (current time:1679982912868). 2023-03-28 05:55:12,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-28 05:55:12,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc41d7f to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:55:12,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@116c6f88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:55:12,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:55:12,877 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57782, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:55:12,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc41d7f to 127.0.0.1:58236 2023-03-28 05:55:12,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:12,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-28 05:55:12,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-28 05:55:12,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-28 05:55:12,881 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-28 05:55:12,881 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679983512881 2023-03-28 05:55:12,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1679982901481-1679982912867 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-28 05:55:12,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-28 05:55:12,882 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:12,882 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-28 05:55:12,982 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:12,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:12,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:12,983 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-28 05:55:13,184 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:13,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:13,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:13,185 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-28 05:55:13,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-28 05:55:13,428 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-28 05:55:13,428 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:55:13,429 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79e2a56f to 127.0.0.1:58236 2023-03-28 05:55:13,429 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:13,429 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-28 05:55:13,429 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-28 05:55:13,429 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-28 05:55:13,429 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-28 05:55:13,430 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-28 05:55:13,429 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-28 05:55:13,429 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:55:13,429 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-28 05:55:13,430 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41be700b to 127.0.0.1:58236 2023-03-28 05:55:13,430 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-28 05:55:13,430 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:13,430 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34dff220 to 127.0.0.1:58236 2023-03-28 05:55:13,430 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:13,430 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:55:13,430 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x396e402c to 127.0.0.1:58236 2023-03-28 05:55:13,430 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:13,431 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:55:13,431 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04d49f2c to 127.0.0.1:58236 2023-03-28 05:55:13,431 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5067fa6780ce4871b54e4ab21b4b7faf, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_] hfiles 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5067fa6780ce4871b54e4ab21b4b7faf 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_ 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a8f42b2ce9164bbaaccdb318238f3683] hfiles 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_ 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a8f42b2ce9164bbaaccdb318238f3683 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/37c6bca8891743ba9d4fb099aef58c84, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_] hfiles 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/37c6bca8891743ba9d4fb099aef58c84 2023-03-28 05:55:13,433 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032882a65d9911724072bd6f3cd1eba515a4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303288c5830715790457f804950cf8beb83fd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032801a72dffb63040219270474aaa306cc5] hfiles 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_ 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032882a65d9911724072bd6f3cd1eba515a4 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/c72dad1930074ef0865d0d66206459a3] hfiles 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303288c5830715790457f804950cf8beb83fd 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/a134c5ba920746c6b715c7042a6a682f] hfiles 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032801a72dffb63040219270474aaa306cc5 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/c72dad1930074ef0865d0d66206459a3 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/a134c5ba920746c6b715c7042a6a682f 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/27065405adee45178cd7d46f1f0ac8e0] hfiles 2023-03-28 05:55:13,434 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/27065405adee45178cd7d46f1f0ac8e0 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303280a28bc7508b84d568254ae381787f24f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328674254d666c5496ea5df27f99d4118ac, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328b9dbe0d14e1f40c59f5a9e4f7ef4ecf6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328cceb58ac27ee4c899b1d43bfcdc2bb50, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328d891c3c3eb774901bea5443a88e1bc7d_del, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032822c1de3ce8ab4d3bbccd0bc98f49929c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032824423e1bb7b64f5eb5ff5b6a22b33358_del, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032870e0acb3f55b4b0da260c20877556448, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328a9d1eb09407448d688634bfa31086091, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328d3521bb0c2a14c1295ab27bff53eb132, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328123b30b121f24bf3a1986866ba56af3c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303281479028a6a274c0da0221fd545a3f1c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303289166684d8c594f91960bbf1538338257, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328d255685e9e2448b6a0f9547caaefef10_del, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328fd5fb270d04049e8a79f20fc503d60a0] hfiles 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303280a28bc7508b84d568254ae381787f24f 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328674254d666c5496ea5df27f99d4118ac 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328b9dbe0d14e1f40c59f5a9e4f7ef4ecf6 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328cceb58ac27ee4c899b1d43bfcdc2bb50 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328d891c3c3eb774901bea5443a88e1bc7d_del 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032822c1de3ce8ab4d3bbccd0bc98f49929c 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032824423e1bb7b64f5eb5ff5b6a22b33358_del 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032870e0acb3f55b4b0da260c20877556448 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328a9d1eb09407448d688634bfa31086091 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230328d3521bb0c2a14c1295ab27bff53eb132 2023-03-28 05:55:13,440 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328123b30b121f24bf3a1986866ba56af3c 2023-03-28 05:55:13,441 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303281479028a6a274c0da0221fd545a3f1c0 2023-03-28 05:55:13,441 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303289166684d8c594f91960bbf1538338257 2023-03-28 05:55:13,441 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328d255685e9e2448b6a0f9547caaefef10_del 2023-03-28 05:55:13,441 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328fd5fb270d04049e8a79f20fc503d60a0 2023-03-28 05:55:13,485 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:13,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:13,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:13,486 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-28 05:55:13,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-28 05:55:13,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:13,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:13,986 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:13,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:13,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:13,988 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-28 05:55:14,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679982901481-1679982912867 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:14,988 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:14,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:14,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-28 05:55:14,989 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-03-28 05:55:15,086 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1679982901481-1679982912867 of table testCompactionWithHFileLink completed 2023-03-28 05:55:15,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:15,087 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:15,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1679982901481-1679982912867 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679982912882Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1679982913288 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1679982901481-1679982912867 at 1679982913845 (+557 ms)Loading Region manifests for hbase-failsafe-snaptb-1679982901481-1679982912867 at 1679982913845Writing data manifest for hbase-failsafe-snaptb-1679982901481-1679982912867 at 1679982913848 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1679982901481-1679982912867 at 1679982914253 (+405 ms)Snapshot hbase-failsafe-snaptb-1679982901481-1679982912867 of table testCompactionWithHFileLink completed at 1679982915086 (+833 ms) 2023-03-28 05:55:15,088 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-28 05:55:15,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.2080 sec 2023-03-28 05:55:16,989 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-28 05:55:16,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-28 05:55:16,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1679982901481-1679982912867 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-28 05:55:17,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679982901481" table: "testCompactionWithHFileLink" creation_time: 1679982901492 type: FLUSH version: 2 ttl: 0 ) 2023-03-28 05:55:17,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1679982901481 as table=testCompactionWithHFileLink 2023-03-28 05:55:17,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-28 05:55:17,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-28 05:55:17,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-28 05:55:17,438 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-28 05:55:17,439 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-28 05:55:17,439 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-28 05:55:17,440 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-28 05:55:17,444 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1679982901481" table: "testCompactionWithHFileLink" creation_time: 1679982901492 type: FLUSH version: 2 ttl: 0 2023-03-28 05:55:17,445 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink 2023-03-28 05:55:17,449 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-28 05:55:17,452 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032801a72dffb63040219270474aaa306cc5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023032801a72dffb63040219270474aaa306cc5 2023-03-28 05:55:17,453 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032882a65d9911724072bd6f3cd1eba515a4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023032882a65d9911724072bd6f3cd1eba515a4 2023-03-28 05:55:17,454 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303288c5830715790457f804950cf8beb83fd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303288c5830715790457f804950cf8beb83fd 2023-03-28 05:55:17,454 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,457 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,460 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,463 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,465 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,468 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,470 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,474 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,476 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,479 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,481 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,484 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 of snapshot=snaptb-1679982901481 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-28 05:55:17,489 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032824423e1bb7b64f5eb5ff5b6a22b33358_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023032824423e1bb7b64f5eb5ff5b6a22b33358_del 2023-03-28 05:55:17,490 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328d891c3c3eb774901bea5443a88e1bc7d_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230328d891c3c3eb774901bea5443a88e1bc7d_del 2023-03-28 05:55:17,491 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328d255685e9e2448b6a0f9547caaefef10_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230328d255685e9e2448b6a0f9547caaefef10_del 2023-03-28 05:55:17,491 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:17,491 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:17,491 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:17,494 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a8f42b2ce9164bbaaccdb318238f3683 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/a8f42b2ce9164bbaaccdb318238f3683 2023-03-28 05:55:17,495 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/37c6bca8891743ba9d4fb099aef58c84 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/37c6bca8891743ba9d4fb099aef58c84 2023-03-28 05:55:17,495 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5067fa6780ce4871b54e4ab21b4b7faf to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/5067fa6780ce4871b54e4ab21b4b7faf 2023-03-28 05:55:17,496 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/48e7c48e6b794444b2ae972a22eba4c6_SeqId_29_ 2023-03-28 05:55:17,496 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 86421ecd2cee47128227a8bf593757a3 of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,496 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/77cc1bc5cc6246a1a2288d91c1f78b34_SeqId_29_ 2023-03-28 05:55:17,496 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9cd2be624432451281d8a112467029bb of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,496 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/fa057711c0a84d38a528895847925fbd_SeqId_29_ 2023-03-28 05:55:17,496 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5146126471d645c8908596ebb9746f58 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,499 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a60410d863dc4e7a9907588fee122dc7 of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,499 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8b8130b1a3314a40b2c60e46379e7108 of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,499 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 345031e3a72c44f7a4ca76b4f80d6012 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,503 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bb9d12c1ef55466984d68b5fbebefbd2 of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,503 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1ae98139d3de44de8106f41a0a91af94 of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,503 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b544dffd423f459bbd078c742b997656 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,508 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f3a6fc1bdcb04e2fa83189b9eeb9138f of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,508 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fcb5518b3b7b4a10bf9b0076f2b47182 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,509 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 494dc8d9216f48f0b70ae7d33fbc5dff of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,519 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/a134c5ba920746c6b715c7042a6a682f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/a134c5ba920746c6b715c7042a6a682f 2023-03-28 05:55:17,519 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2b62ba8baa164e8b9710a82d996d5382 of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,520 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/c72dad1930074ef0865d0d66206459a3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/c72dad1930074ef0865d0d66206459a3 2023-03-28 05:55:17,520 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5396d89c753848b48bd06195dce49392 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,521 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/27065405adee45178cd7d46f1f0ac8e0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/27065405adee45178cd7d46f1f0ac8e0 2023-03-28 05:55:17,521 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b37a2350ac8043c5a92b7670a9bda3b2 of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,523 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6aee4f92673744a79774b113c267a183 of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,525 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 767fecffbc63478b9f4fd5eaf0575c77 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,525 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e7497dd47f5644ccbdedf071442194d3 of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,527 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b1bf347bbcae4069b518fe8072001dcc of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,529 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bf4cc82571024abba5a4b444016a5069 of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,529 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cded5e69144f441ca8d26234d49134c0 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,532 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2fbe14a668d24465809e717eb47c3852 of snapshot=snaptb-1679982901481 to region=87940ac43ab7a9d87409f4d6e787bb07 table=testCompactionWithHFileLink 2023-03-28 05:55:17,533 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 446a9f79e1ad4d27846fbdecd4874093 of snapshot=snaptb-1679982901481 to region=f2b46b886f1b7cf3ce6017631b923841 table=testCompactionWithHFileLink 2023-03-28 05:55:17,534 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 328e6331386b47a4b9a6d403da8c9e11 of snapshot=snaptb-1679982901481 to region=df36b35bd32c0c4727983225bdf25a02 table=testCompactionWithHFileLink 2023-03-28 05:55:17,538 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1679982901481" table: "testCompactionWithHFileLink" creation_time: 1679982901492 type: FLUSH version: 2 ttl: 0 2023-03-28 05:55:17,539 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679982917539"}]},"ts":"9223372036854775807"} 2023-03-28 05:55:17,539 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679982917539"}]},"ts":"9223372036854775807"} 2023-03-28 05:55:17,539 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679982917539"}]},"ts":"9223372036854775807"} 2023-03-28 05:55:17,541 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-28 05:55:17,541 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87940ac43ab7a9d87409f4d6e787bb07, NAME => 'testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => df36b35bd32c0c4727983225bdf25a02, NAME => 'testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f2b46b886f1b7cf3ce6017631b923841, NAME => 'testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.', STARTKEY => '', ENDKEY => '1'}] 2023-03-28 05:55:17,541 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982917540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982917540"}]},"ts":"1679982917540"} 2023-03-28 05:55:17,541 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982917540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982917540"}]},"ts":"1679982917540"} 2023-03-28 05:55:17,541 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982917540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982917540"}]},"ts":"1679982917540"} 2023-03-28 05:55:17,543 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-28 05:55:17,543 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-28 05:55:17,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 87940ac43ab7a9d87409f4d6e787bb07, NAME => 'testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => df36b35bd32c0c4727983225bdf25a02, NAME => 'testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f2b46b886f1b7cf3ce6017631b923841, NAME => 'testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.', STARTKEY => '', ENDKEY => '1'}] 2023-03-28 05:55:17,544 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1679982901481 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-28 05:55:17,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679982901481" table: "testCompactionWithHFileLink" creation_time: 1679982901492 type: FLUSH version: 2 ttl: 0 ) in 524 msec 2023-03-28 05:55:17,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-28 05:55:17,635 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-28 05:55:17,635 INFO [Listener at localhost/33463] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:17,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1679982901481-1679982912867" 2023-03-28 05:55:17,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1679982901481-1679982912867 2023-03-28 05:55:17,648 INFO [Listener at localhost/33463] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-28 05:55:17,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-03-28 05:55:17,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-28 05:55:17,663 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-28 05:55:17,664 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982917664"}]},"ts":"1679982917664"} 2023-03-28 05:55:17,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-28 05:55:17,665 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-28 05:55:17,667 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-28 05:55:17,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN}] 2023-03-28 05:55:17,673 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN 2023-03-28 05:55:17,674 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-28 05:55:17,674 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN 2023-03-28 05:55:17,675 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN 2023-03-28 05:55:17,675 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-28 05:55:17,676 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-28 05:55:17,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-28 05:55:17,825 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=df36b35bd32c0c4727983225bdf25a02, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:17,825 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=87940ac43ab7a9d87409f4d6e787bb07, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:17,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982917825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982917825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982917825"}]},"ts":"1679982917825"} 2023-03-28 05:55:17,825 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f2b46b886f1b7cf3ce6017631b923841, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:17,826 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982917825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982917825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982917825"}]},"ts":"1679982917825"} 2023-03-28 05:55:17,826 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982917825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982917825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982917825"}]},"ts":"1679982917825"} 2023-03-28 05:55:17,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure df36b35bd32c0c4727983225bdf25a02, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:17,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 87940ac43ab7a9d87409f4d6e787bb07, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:17,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure f2b46b886f1b7cf3ce6017631b923841, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:17,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-28 05:55:17,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:17,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2b46b886f1b7cf3ce6017631b923841, NAME => 'testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.', STARTKEY => '', ENDKEY => '1'} 2023-03-28 05:55:17,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:17,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:17,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:17,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:17,984 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:17,985 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:55:17,985 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:55:17,985 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2b46b886f1b7cf3ce6017631b923841 columnFamilyName family1 2023-03-28 05:55:18,004 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-1ae98139d3de44de8106f41a0a91af94 2023-03-28 05:55:18,010 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-494dc8d9216f48f0b70ae7d33fbc5dff 2023-03-28 05:55:18,016 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-8b8130b1a3314a40b2c60e46379e7108 2023-03-28 05:55:18,023 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-9cd2be624432451281d8a112467029bb 2023-03-28 05:55:18,024 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(310): Store=f2b46b886f1b7cf3ce6017631b923841/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:18,024 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:18,025 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2 2023-03-28 05:55:18,025 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2 2023-03-28 05:55:18,026 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2b46b886f1b7cf3ce6017631b923841 columnFamilyName family2 2023-03-28 05:55:18,056 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-446a9f79e1ad4d27846fbdecd4874093 2023-03-28 05:55:18,065 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-b37a2350ac8043c5a92b7670a9bda3b2 2023-03-28 05:55:18,078 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-bf4cc82571024abba5a4b444016a5069 2023-03-28 05:55:18,087 DEBUG [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-e7497dd47f5644ccbdedf071442194d3 2023-03-28 05:55:18,087 INFO [StoreOpener-f2b46b886f1b7cf3ce6017631b923841-1] regionserver.HStore(310): Store=f2b46b886f1b7cf3ce6017631b923841/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:18,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:18,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:18,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:18,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:55:18,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2b46b886f1b7cf3ce6017631b923841; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67544609, jitterRate=0.006493106484413147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:18,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:18,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841., pid=103, masterSystemTime=1679982917979 2023-03-28 05:55:18,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-28 05:55:18,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-28 05:55:18,101 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-28 05:55:18,101 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-28 05:55:18,103 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f2b46b886f1b7cf3ce6017631b923841, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:18,103 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982918103"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982918103"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982918103"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982918103"}]},"ts":"1679982918103"} 2023-03-28 05:55:18,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:18,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:18,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:18,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87940ac43ab7a9d87409f4d6e787bb07, NAME => 'testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.', STARTKEY => '1', ENDKEY => '2'} 2023-03-28 05:55:18,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:18,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-03-28 05:55:18,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure f2b46b886f1b7cf3ce6017631b923841, server=jenkins-hbase4.apache.org,39167,1679982818904 in 277 msec 2023-03-28 05:55:18,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f2b46b886f1b7cf3ce6017631b923841, ASSIGN in 440 msec 2023-03-28 05:55:18,110 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,110 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-28 05:55:18,110 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1912): f2b46b886f1b7cf3ce6017631b923841/family2 is initiating minor compaction (all files) 2023-03-28 05:55:18,110 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f2b46b886f1b7cf3ce6017631b923841/family2 in testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:18,110 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-b37a2350ac8043c5a92b7670a9bda3b2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-e7497dd47f5644ccbdedf071442194d3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-bf4cc82571024abba5a4b444016a5069, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-446a9f79e1ad4d27846fbdecd4874093] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp, totalSize=20.4 K 2023-03-28 05:55:18,111 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-28 05:55:18,111 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1912): f2b46b886f1b7cf3ce6017631b923841/family1 is initiating minor compaction (all files) 2023-03-28 05:55:18,111 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f2b46b886f1b7cf3ce6017631b923841/family1 in testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:55:18,111 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-9cd2be624432451281d8a112467029bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-8b8130b1a3314a40b2c60e46379e7108, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-1ae98139d3de44de8106f41a0a91af94, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-494dc8d9216f48f0b70ae7d33fbc5dff] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp, totalSize=21.6 K 2023-03-28 05:55:18,112 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-b37a2350ac8043c5a92b7670a9bda3b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895627 2023-03-28 05:55:18,112 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-9cd2be624432451281d8a112467029bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895627 2023-03-28 05:55:18,113 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:55:18,113 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:55:18,113 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-e7497dd47f5644ccbdedf071442194d3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897459 2023-03-28 05:55:18,113 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-8b8130b1a3314a40b2c60e46379e7108, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897459 2023-03-28 05:55:18,114 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87940ac43ab7a9d87409f4d6e787bb07 columnFamilyName family1 2023-03-28 05:55:18,114 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-1ae98139d3de44de8106f41a0a91af94, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898577 2023-03-28 05:55:18,114 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-bf4cc82571024abba5a4b444016a5069, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898577 2023-03-28 05:55:18,116 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-494dc8d9216f48f0b70ae7d33fbc5dff, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:18,121 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-446a9f79e1ad4d27846fbdecd4874093, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:18,148 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-86421ecd2cee47128227a8bf593757a3 2023-03-28 05:55:18,183 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-a60410d863dc4e7a9907588fee122dc7 2023-03-28 05:55:18,218 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-bb9d12c1ef55466984d68b5fbebefbd2 2023-03-28 05:55:18,227 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): f2b46b886f1b7cf3ce6017631b923841#family2#compaction#114 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:18,236 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] throttle.PressureAwareThroughputController(145): f2b46b886f1b7cf3ce6017631b923841#family1#compaction#115 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:18,244 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-f3a6fc1bdcb04e2fa83189b9eeb9138f 2023-03-28 05:55:18,250 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(310): Store=87940ac43ab7a9d87409f4d6e787bb07/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:18,251 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,252 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2 2023-03-28 05:55:18,252 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2 2023-03-28 05:55:18,252 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87940ac43ab7a9d87409f4d6e787bb07 columnFamilyName family2 2023-03-28 05:55:18,265 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2b62ba8baa164e8b9710a82d996d5382 2023-03-28 05:55:18,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-28 05:55:18,270 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2fbe14a668d24465809e717eb47c3852 2023-03-28 05:55:18,271 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:55:18,275 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-6aee4f92673744a79774b113c267a183 2023-03-28 05:55:18,287 DEBUG [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-b1bf347bbcae4069b518fe8072001dcc 2023-03-28 05:55:18,287 INFO [StoreOpener-87940ac43ab7a9d87409f4d6e787bb07-1] regionserver.HStore(310): Store=87940ac43ab7a9d87409f4d6e787bb07/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:18,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:18,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:55:18,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87940ac43ab7a9d87409f4d6e787bb07; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70520478, jitterRate=0.05083701014518738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:18,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:18,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07., pid=102, masterSystemTime=1679982917979 2023-03-28 05:55:18,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-28 05:55:18,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-28 05:55:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:18,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:18,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => df36b35bd32c0c4727983225bdf25a02, NAME => 'testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.', STARTKEY => '2', ENDKEY => ''} 2023-03-28 05:55:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,301 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=87940ac43ab7a9d87409f4d6e787bb07, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:18,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,302 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982918301"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982918301"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982918301"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982918301"}]},"ts":"1679982918301"} 2023-03-28 05:55:18,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,304 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=99 2023-03-28 05:55:18,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 87940ac43ab7a9d87409f4d6e787bb07, server=jenkins-hbase4.apache.org,39167,1679982818904 in 475 msec 2023-03-28 05:55:18,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=87940ac43ab7a9d87409f4d6e787bb07, ASSIGN in 637 msec 2023-03-28 05:55:18,307 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family1/5b48968df3654d59b54b773e8ec74a76 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/5b48968df3654d59b54b773e8ec74a76 2023-03-28 05:55:18,307 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:55:18,307 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:55:18,308 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df36b35bd32c0c4727983225bdf25a02 columnFamilyName family1 2023-03-28 05:55:18,321 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-28 05:55:18,322 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f2b46b886f1b7cf3ce6017631b923841/family1 of f2b46b886f1b7cf3ce6017631b923841 into 5b48968df3654d59b54b773e8ec74a76(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:18,322 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:18,322 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841., storeName=f2b46b886f1b7cf3ce6017631b923841/family1, priority=12, startTime=1679982918100; duration=0sec 2023-03-28 05:55:18,322 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-28 05:55:18,323 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-28 05:55:18,328 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-28 05:55:18,328 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-345031e3a72c44f7a4ca76b4f80d6012 2023-03-28 05:55:18,329 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1912): 87940ac43ab7a9d87409f4d6e787bb07/family1 is initiating minor compaction (all files) 2023-03-28 05:55:18,329 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 87940ac43ab7a9d87409f4d6e787bb07/family1 in testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:18,329 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-86421ecd2cee47128227a8bf593757a3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-a60410d863dc4e7a9907588fee122dc7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-bb9d12c1ef55466984d68b5fbebefbd2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-f3a6fc1bdcb04e2fa83189b9eeb9138f] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp, totalSize=21.6 K 2023-03-28 05:55:18,330 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-86421ecd2cee47128227a8bf593757a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895628 2023-03-28 05:55:18,331 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-a60410d863dc4e7a9907588fee122dc7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:18,332 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-bb9d12c1ef55466984d68b5fbebefbd2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:18,332 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-f3a6fc1bdcb04e2fa83189b9eeb9138f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:18,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-9cd2be624432451281d8a112467029bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-8b8130b1a3314a40b2c60e46379e7108, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-1ae98139d3de44de8106f41a0a91af94, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-494dc8d9216f48f0b70ae7d33fbc5dff] to archive 2023-03-28 05:55:18,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:18,335 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5146126471d645c8908596ebb9746f58 2023-03-28 05:55:18,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-9cd2be624432451281d8a112467029bb to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-9cd2be624432451281d8a112467029bb 2023-03-28 05:55:18,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-8b8130b1a3314a40b2c60e46379e7108 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-8b8130b1a3314a40b2c60e46379e7108 2023-03-28 05:55:18,345 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-b544dffd423f459bbd078c742b997656 2023-03-28 05:55:18,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-1ae98139d3de44de8106f41a0a91af94 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-1ae98139d3de44de8106f41a0a91af94 2023-03-28 05:55:18,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-494dc8d9216f48f0b70ae7d33fbc5dff to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-494dc8d9216f48f0b70ae7d33fbc5dff 2023-03-28 05:55:18,354 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-fcb5518b3b7b4a10bf9b0076f2b47182 2023-03-28 05:55:18,354 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(310): Store=df36b35bd32c0c4727983225bdf25a02/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:18,355 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,355 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2 2023-03-28 05:55:18,355 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2 2023-03-28 05:55:18,356 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df36b35bd32c0c4727983225bdf25a02 columnFamilyName family2 2023-03-28 05:55:18,379 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-328e6331386b47a4b9a6d403da8c9e11 2023-03-28 05:55:18,383 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] throttle.PressureAwareThroughputController(145): 87940ac43ab7a9d87409f4d6e787bb07#family1#compaction#116 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:18,392 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5396d89c753848b48bd06195dce49392 2023-03-28 05:55:18,408 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-767fecffbc63478b9f4fd5eaf0575c77 2023-03-28 05:55:18,413 DEBUG [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(539): loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-cded5e69144f441ca8d26234d49134c0 2023-03-28 05:55:18,413 INFO [StoreOpener-df36b35bd32c0c4727983225bdf25a02-1] regionserver.HStore(310): Store=df36b35bd32c0c4727983225bdf25a02/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:18,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:18,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:55:18,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened df36b35bd32c0c4727983225bdf25a02; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61924866, jitterRate=-0.07724758982658386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:18,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:18,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02., pid=101, masterSystemTime=1679982917979 2023-03-28 05:55:18,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-28 05:55:18,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-28 05:55:18,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:18,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:18,421 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=df36b35bd32c0c4727983225bdf25a02, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:18,421 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679982918420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982918420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982918420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982918420"}]},"ts":"1679982918420"} 2023-03-28 05:55:18,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-03-28 05:55:18,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure df36b35bd32c0c4727983225bdf25a02, server=jenkins-hbase4.apache.org,39167,1679982818904 in 595 msec 2023-03-28 05:55:18,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-03-28 05:55:18,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=df36b35bd32c0c4727983225bdf25a02, ASSIGN in 765 msec 2023-03-28 05:55:18,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982918435"}]},"ts":"1679982918435"} 2023-03-28 05:55:18,436 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-28 05:55:18,438 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-28 05:55:18,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 783 msec 2023-03-28 05:55:18,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-28 05:55:18,768 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-28 05:55:18,775 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:18,785 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:18,796 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:18,797 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:18,804 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-28 05:55:18,824 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-28 05:55:18,825 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:18,825 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(139): Connect 0x27841654 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:55:18,830 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eb5e46c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:55:18,830 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:18,830 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:18,830 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:19,069 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/.tmp/family2/228292a04a95429a9e64e728d1d940d1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/228292a04a95429a9e64e728d1d940d1 2023-03-28 05:55:19,075 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f2b46b886f1b7cf3ce6017631b923841/family2 of f2b46b886f1b7cf3ce6017631b923841 into 228292a04a95429a9e64e728d1d940d1(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:19,075 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:19,075 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841., storeName=f2b46b886f1b7cf3ce6017631b923841/family2, priority=12, startTime=1679982918101; duration=0sec 2023-03-28 05:55:19,075 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-28 05:55:19,075 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-28 05:55:19,077 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-28 05:55:19,077 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1912): 87940ac43ab7a9d87409f4d6e787bb07/family2 is initiating minor compaction (all files) 2023-03-28 05:55:19,077 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 87940ac43ab7a9d87409f4d6e787bb07/family2 in testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:55:19,077 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2b62ba8baa164e8b9710a82d996d5382, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-6aee4f92673744a79774b113c267a183, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-b1bf347bbcae4069b518fe8072001dcc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2fbe14a668d24465809e717eb47c3852] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp, totalSize=20.4 K 2023-03-28 05:55:19,078 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2b62ba8baa164e8b9710a82d996d5382, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895628 2023-03-28 05:55:19,079 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-6aee4f92673744a79774b113c267a183, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:19,080 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-b1bf347bbcae4069b518fe8072001dcc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:19,081 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2fbe14a668d24465809e717eb47c3852, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:19,094 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 87940ac43ab7a9d87409f4d6e787bb07#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:19,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-b37a2350ac8043c5a92b7670a9bda3b2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-e7497dd47f5644ccbdedf071442194d3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-bf4cc82571024abba5a4b444016a5069, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-446a9f79e1ad4d27846fbdecd4874093] to archive 2023-03-28 05:55:19,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:19,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-b37a2350ac8043c5a92b7670a9bda3b2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-b37a2350ac8043c5a92b7670a9bda3b2 2023-03-28 05:55:19,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-e7497dd47f5644ccbdedf071442194d3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-e7497dd47f5644ccbdedf071442194d3 2023-03-28 05:55:19,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-bf4cc82571024abba5a4b444016a5069 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-bf4cc82571024abba5a4b444016a5069 2023-03-28 05:55:19,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-446a9f79e1ad4d27846fbdecd4874093 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family2/testCompactionWithHFileLink=f2b46b886f1b7cf3ce6017631b923841-446a9f79e1ad4d27846fbdecd4874093 2023-03-28 05:55:19,228 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family1/708895af5ae24aa5bb1dd4c3bd136952 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/708895af5ae24aa5bb1dd4c3bd136952 2023-03-28 05:55:19,234 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 87940ac43ab7a9d87409f4d6e787bb07/family1 of 87940ac43ab7a9d87409f4d6e787bb07 into 708895af5ae24aa5bb1dd4c3bd136952(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:19,234 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:19,234 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07., storeName=87940ac43ab7a9d87409f4d6e787bb07/family1, priority=12, startTime=1679982918299; duration=0sec 2023-03-28 05:55:19,235 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-28 05:55:19,236 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-28 05:55:19,238 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-28 05:55:19,238 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1912): df36b35bd32c0c4727983225bdf25a02/family2 is initiating minor compaction (all files) 2023-03-28 05:55:19,238 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegion(2259): Starting compaction of df36b35bd32c0c4727983225bdf25a02/family2 in testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:19,238 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5396d89c753848b48bd06195dce49392, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-767fecffbc63478b9f4fd5eaf0575c77, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-cded5e69144f441ca8d26234d49134c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-328e6331386b47a4b9a6d403da8c9e11] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp, totalSize=20.4 K 2023-03-28 05:55:19,239 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5396d89c753848b48bd06195dce49392, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895629 2023-03-28 05:55:19,239 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-767fecffbc63478b9f4fd5eaf0575c77, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:19,240 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-cded5e69144f441ca8d26234d49134c0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:19,241 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-328e6331386b47a4b9a6d403da8c9e11, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:19,255 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] throttle.PressureAwareThroughputController(145): df36b35bd32c0c4727983225bdf25a02#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:19,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-86421ecd2cee47128227a8bf593757a3, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-a60410d863dc4e7a9907588fee122dc7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-bb9d12c1ef55466984d68b5fbebefbd2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-f3a6fc1bdcb04e2fa83189b9eeb9138f] to archive 2023-03-28 05:55:19,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:19,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-86421ecd2cee47128227a8bf593757a3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-86421ecd2cee47128227a8bf593757a3 2023-03-28 05:55:19,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-a60410d863dc4e7a9907588fee122dc7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-a60410d863dc4e7a9907588fee122dc7 2023-03-28 05:55:19,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-bb9d12c1ef55466984d68b5fbebefbd2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-bb9d12c1ef55466984d68b5fbebefbd2 2023-03-28 05:55:19,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-f3a6fc1bdcb04e2fa83189b9eeb9138f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-f3a6fc1bdcb04e2fa83189b9eeb9138f 2023-03-28 05:55:19,363 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328db334407437448d492fa1a12383c49a5 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230328db334407437448d492fa1a12383c49a5 2023-03-28 05:55:19,364 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328977d0ae49a7b462a8844f958a2953949 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230328977d0ae49a7b462a8844f958a2953949 2023-03-28 05:55:19,364 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:19,370 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:19,390 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:55:19,411 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41280, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:55:19,424 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328338b1dff29e2419a9870382e26dbae0d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230328338b1dff29e2419a9870382e26dbae0d 2023-03-28 05:55:19,426 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:19,435 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:55:19,487 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41790, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:55:19,569 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/701ce8e582674470a51e95520de8e4c9 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-28 05:55:19,571 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=32 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/701ce8e582674470a51e95520de8e4c9}] 2023-03-28 05:55:19,582 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/9ad77ff56d704537bd42fcd5a61067c1 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-28 05:55:19,583 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/701ce8e582674470a51e95520de8e4c9 for inclusion in f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:55:19,583 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/9ad77ff56d704537bd42fcd5a61067c1}] 2023-03-28 05:55:19,584 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/959111989a48456fa2dfa7cb0b66d74b first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-28 05:55:19,585 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/959111989a48456fa2dfa7cb0b66d74b}] 2023-03-28 05:55:19,587 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/9ad77ff56d704537bd42fcd5a61067c1 for inclusion in 87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:55:19,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/959111989a48456fa2dfa7cb0b66d74b for inclusion in df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:55:19,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-28 05:55:19,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last=1 2023-03-28 05:55:19,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:55:19,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-28 05:55:19,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-28 05:55:19,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:19,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328/family1/701ce8e582674470a51e95520de8e4c9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__3t4mc1sjtrot2pr9f6749ldk35j13mltuhcdjc3m7al24r7s4hjntaol75ibtfpp/family1/701ce8e582674470a51e95520de8e4c9 2023-03-28 05:55:19,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-28 05:55:19,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-28 05:55:19,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328/family1/9ad77ff56d704537bd42fcd5a61067c1 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__bo96n12k5kjrttiko9sm7drsikoukjmq155bkv69s1i7bn4a150gv9t479fufi60/family1/9ad77ff56d704537bd42fcd5a61067c1 2023-03-28 05:55:19,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:19,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328/family1/959111989a48456fa2dfa7cb0b66d74b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__lnsg5l2p5dro1ck94o617mj2t0r8v3u6dcrlup4vqocqcvbk5d5nqc1vcnme4f61/family1/959111989a48456fa2dfa7cb0b66d74b 2023-03-28 05:55:19,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__3t4mc1sjtrot2pr9f6749ldk35j13mltuhcdjc3m7al24r7s4hjntaol75ibtfpp/family1/701ce8e582674470a51e95520de8e4c9 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/b4416281512e4f06a95cce6fa27529af_SeqId_36_ 2023-03-28 05:55:19,594 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__3t4mc1sjtrot2pr9f6749ldk35j13mltuhcdjc3m7al24r7s4hjntaol75ibtfpp/family1/701ce8e582674470a51e95520de8e4c9 into f2b46b886f1b7cf3ce6017631b923841/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/b4416281512e4f06a95cce6fa27529af_SeqId_36_ - updating store file list. 2023-03-28 05:55:19,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__bo96n12k5kjrttiko9sm7drsikoukjmq155bkv69s1i7bn4a150gv9t479fufi60/family1/9ad77ff56d704537bd42fcd5a61067c1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/3464904726914541aeb3f68c89ad3c59_SeqId_35_ 2023-03-28 05:55:19,595 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__bo96n12k5kjrttiko9sm7drsikoukjmq155bkv69s1i7bn4a150gv9t479fufi60/family1/9ad77ff56d704537bd42fcd5a61067c1 into 87940ac43ab7a9d87409f4d6e787bb07/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/3464904726914541aeb3f68c89ad3c59_SeqId_35_ - updating store file list. 2023-03-28 05:55:19,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__lnsg5l2p5dro1ck94o617mj2t0r8v3u6dcrlup4vqocqcvbk5d5nqc1vcnme4f61/family1/959111989a48456fa2dfa7cb0b66d74b as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_ 2023-03-28 05:55:19,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__lnsg5l2p5dro1ck94o617mj2t0r8v3u6dcrlup4vqocqcvbk5d5nqc1vcnme4f61/family1/959111989a48456fa2dfa7cb0b66d74b into df36b35bd32c0c4727983225bdf25a02/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_ - updating store file list. 2023-03-28 05:55:19,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/3464904726914541aeb3f68c89ad3c59_SeqId_35_ into 87940ac43ab7a9d87409f4d6e787bb07/family1 2023-03-28 05:55:19,600 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__bo96n12k5kjrttiko9sm7drsikoukjmq155bkv69s1i7bn4a150gv9t479fufi60/family1/9ad77ff56d704537bd42fcd5a61067c1 into 87940ac43ab7a9d87409f4d6e787bb07/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family1/3464904726914541aeb3f68c89ad3c59_SeqId_35_) 2023-03-28 05:55:19,600 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/.tmp/family2/36285320fb104ee1970a2a06eb87de72 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/36285320fb104ee1970a2a06eb87de72 2023-03-28 05:55:19,600 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/b4416281512e4f06a95cce6fa27529af_SeqId_36_ into f2b46b886f1b7cf3ce6017631b923841/family1 2023-03-28 05:55:19,600 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__3t4mc1sjtrot2pr9f6749ldk35j13mltuhcdjc3m7al24r7s4hjntaol75ibtfpp/family1/701ce8e582674470a51e95520de8e4c9 into f2b46b886f1b7cf3ce6017631b923841/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/family1/b4416281512e4f06a95cce6fa27529af_SeqId_36_) 2023-03-28 05:55:19,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__bo96n12k5kjrttiko9sm7drsikoukjmq155bkv69s1i7bn4a150gv9t479fufi60/family1/9ad77ff56d704537bd42fcd5a61067c1 2023-03-28 05:55:19,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_ into df36b35bd32c0c4727983225bdf25a02/family1 2023-03-28 05:55:19,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__lnsg5l2p5dro1ck94o617mj2t0r8v3u6dcrlup4vqocqcvbk5d5nqc1vcnme4f61/family1/959111989a48456fa2dfa7cb0b66d74b into df36b35bd32c0c4727983225bdf25a02/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_) 2023-03-28 05:55:19,602 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:19,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__lnsg5l2p5dro1ck94o617mj2t0r8v3u6dcrlup4vqocqcvbk5d5nqc1vcnme4f61/family1/959111989a48456fa2dfa7cb0b66d74b 2023-03-28 05:55:19,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:19,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testCompactionWithHFileLink__3t4mc1sjtrot2pr9f6749ldk35j13mltuhcdjc3m7al24r7s4hjntaol75ibtfpp/family1/701ce8e582674470a51e95520de8e4c9 2023-03-28 05:55:19,603 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:19,605 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 87940ac43ab7a9d87409f4d6e787bb07/family2 of 87940ac43ab7a9d87409f4d6e787bb07 into 36285320fb104ee1970a2a06eb87de72(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:19,605 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:55:19,605 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07., storeName=87940ac43ab7a9d87409f4d6e787bb07/family2, priority=12, startTime=1679982918299; duration=0sec 2023-03-28 05:55:19,605 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303280cf04a6664d0433dade07783abfcb32b 2023-03-28 05:55:19,606 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:19,607 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:19,607 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230328210ca618322b4bbf8e33724dbe5c8a65 2023-03-28 05:55:19,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-28 05:55:19,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(1912): df36b35bd32c0c4727983225bdf25a02/family1 is initiating minor compaction (all files) 2023-03-28 05:55:19,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1f84db3c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-28 05:55:19,609 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230328851fd95ba0fc4566af3e4b957eb6a6af 2023-03-28 05:55:19,609 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-28 05:55:19,609 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of df36b35bd32c0c4727983225bdf25a02/family1 in testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:55:19,609 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023032885a3a0ceeef0493a882502cf2596e6b2 2023-03-28 05:55:19,609 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5146126471d645c8908596ebb9746f58, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-345031e3a72c44f7a4ca76b4f80d6012, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-b544dffd423f459bbd078c742b997656, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-fcb5518b3b7b4a10bf9b0076f2b47182, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp, totalSize=28.9 K 2023-03-28 05:55:19,610 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5146126471d645c8908596ebb9746f58, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982895629 2023-03-28 05:55:19,610 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230328f6ef0d43840140a8b7f1139a310c43f4 2023-03-28 05:55:19,611 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-28 05:55:19,611 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230328' 2023-03-28 05:55:19,611 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303288771cc13c0d241c9a70a2e5771f6cb71 2023-03-28 05:55:19,612 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:19,612 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230328909486a8bf424fb1b4bc2f0bf9d4213e 2023-03-28 05:55:19,613 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:19,614 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-345031e3a72c44f7a4ca76b4f80d6012, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982897460 2023-03-28 05:55:19,614 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-b544dffd423f459bbd078c742b997656, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982898578 2023-03-28 05:55:19,615 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:19,616 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230328b42a152de946487a90d3b60999517962 2023-03-28 05:55:19,616 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-28 05:55:19,616 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230328' 2023-03-28 05:55:19,616 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:19,617 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328265f4516eced45f5897db4301b253b9a 2023-03-28 05:55:19,618 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-fcb5518b3b7b4a10bf9b0076f2b47182, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982900427 2023-03-28 05:55:19,618 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328344a12fdfee6448a955ad4fd538ef52f 2023-03-28 05:55:19,619 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1679982895629 2023-03-28 05:55:19,620 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328ad6618b4488d46c18e0adf61934ab2dc 2023-03-28 05:55:19,621 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230328b75f7f1a609c4463904a4aa0c5a9079e 2023-03-28 05:55:19,621 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-28 05:55:19,621 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230328' 2023-03-28 05:55:19,622 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230328 for table='testCompactionWithHFileLink' and column='family1' 2023-03-28 05:55:19,622 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-28 05:55:19,626 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:19,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2b62ba8baa164e8b9710a82d996d5382, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-6aee4f92673744a79774b113c267a183, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-b1bf347bbcae4069b518fe8072001dcc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2fbe14a668d24465809e717eb47c3852] to archive 2023-03-28 05:55:19,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:19,632 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:19,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2b62ba8baa164e8b9710a82d996d5382 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2b62ba8baa164e8b9710a82d996d5382 2023-03-28 05:55:19,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-6aee4f92673744a79774b113c267a183 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-6aee4f92673744a79774b113c267a183 2023-03-28 05:55:19,636 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:19,637 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:19,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-b1bf347bbcae4069b518fe8072001dcc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-b1bf347bbcae4069b518fe8072001dcc 2023-03-28 05:55:19,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2fbe14a668d24465809e717eb47c3852 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/family2/testCompactionWithHFileLink=87940ac43ab7a9d87409f4d6e787bb07-2fbe14a668d24465809e717eb47c3852 2023-03-28 05:55:19,645 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:19,646 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:19,659 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): df36b35bd32c0c4727983225bdf25a02#family1#compaction#119 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:19,677 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=275 (was 248) - Thread LEAK? -, OpenFileDescriptor=709 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=360 (was 451), ProcessCount=170 (was 171), AvailableMemoryMB=4135 (was 4216) 2023-03-28 05:55:19,691 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=275, OpenFileDescriptor=707, MaxFileDescriptor=60000, SystemLoadAverage=360, ProcessCount=170, AvailableMemoryMB=4134 2023-03-28 05:55:19,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-03-28 05:55:19,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-28 05:55:19,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-28 05:55:19,704 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-28 05:55:19,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-03-28 05:55:19,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-28 05:55:19,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-28 05:55:19,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-28 05:55:19,806 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:55:19,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-28 05:55:19,807 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:55:19,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-28 05:55:19,809 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d 2023-03-28 05:55:19,809 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:19,809 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:19,810 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d empty. 2023-03-28 05:55:19,810 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea empty. 2023-03-28 05:55:19,810 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793 empty. 2023-03-28 05:55:19,810 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d 2023-03-28 05:55:19,810 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:19,810 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:19,810 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-28 05:55:19,819 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-28 05:55:19,821 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 76bc919d1afa95f1382595342810654d, NAME => 'ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:55:19,821 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => e5f52d0654050f53e3182942577dbeea, NAME => 'ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:55:19,824 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2d9e2d69c8fe93609783c176a23cd793, NAME => 'ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:55:19,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-28 05:55:20,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-28 05:55:20,241 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:20,241 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 76bc919d1afa95f1382595342810654d, disabling compactions & flushes 2023-03-28 05:55:20,241 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,241 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,241 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. after waiting 0 ms 2023-03-28 05:55:20,241 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,241 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,241 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:20,244 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:20,244 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing e5f52d0654050f53e3182942577dbeea, disabling compactions & flushes 2023-03-28 05:55:20,244 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,244 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,244 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. after waiting 0 ms 2023-03-28 05:55:20,244 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,244 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,244 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:20,249 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:20,249 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 2d9e2d69c8fe93609783c176a23cd793, disabling compactions & flushes 2023-03-28 05:55:20,249 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,249 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,249 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. after waiting 0 ms 2023-03-28 05:55:20,249 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,249 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,249 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:20,251 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:55:20,252 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679982920252"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982920252"}]},"ts":"1679982920252"} 2023-03-28 05:55:20,253 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679982920252"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982920252"}]},"ts":"1679982920252"} 2023-03-28 05:55:20,253 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679982920252"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982920252"}]},"ts":"1679982920252"} 2023-03-28 05:55:20,255 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-28 05:55:20,255 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:55:20,256 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982920255"}]},"ts":"1679982920255"} 2023-03-28 05:55:20,257 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-28 05:55:20,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76bc919d1afa95f1382595342810654d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e5f52d0654050f53e3182942577dbeea, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2d9e2d69c8fe93609783c176a23cd793, ASSIGN}] 2023-03-28 05:55:20,262 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2d9e2d69c8fe93609783c176a23cd793, ASSIGN 2023-03-28 05:55:20,262 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76bc919d1afa95f1382595342810654d, ASSIGN 2023-03-28 05:55:20,262 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e5f52d0654050f53e3182942577dbeea, ASSIGN 2023-03-28 05:55:20,263 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2d9e2d69c8fe93609783c176a23cd793, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:55:20,263 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76bc919d1afa95f1382595342810654d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:55:20,263 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e5f52d0654050f53e3182942577dbeea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:55:20,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-28 05:55:20,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=2d9e2d69c8fe93609783c176a23cd793, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=76bc919d1afa95f1382595342810654d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679982920415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982920415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982920415"}]},"ts":"1679982920415"} 2023-03-28 05:55:20,416 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e5f52d0654050f53e3182942577dbeea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679982920415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982920415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982920415"}]},"ts":"1679982920415"} 2023-03-28 05:55:20,416 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679982920416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982920416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982920416"}]},"ts":"1679982920416"} 2023-03-28 05:55:20,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 76bc919d1afa95f1382595342810654d, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:20,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 2d9e2d69c8fe93609783c176a23cd793, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:20,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure e5f52d0654050f53e3182942577dbeea, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:20,476 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family2/fcecf5261f8f418484e5512956f5ae7d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/fcecf5261f8f418484e5512956f5ae7d 2023-03-28 05:55:20,481 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in df36b35bd32c0c4727983225bdf25a02/family2 of df36b35bd32c0c4727983225bdf25a02 into fcecf5261f8f418484e5512956f5ae7d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:55:20,481 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:20,481 INFO [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02., storeName=df36b35bd32c0c4727983225bdf25a02/family2, priority=12, startTime=1679982918419; duration=1sec 2023-03-28 05:55:20,481 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-28 05:55:20,481 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-03-28 05:55:20,481 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-28 05:55:20,481 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-28 05:55:20,481 DEBUG [RS:0;jenkins-hbase4:39167-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. because compaction request was cancelled 2023-03-28 05:55:20,482 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/.tmp/family1/8b79b0d14bfa4fa08e0021b2ad2d5692 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/8b79b0d14bfa4fa08e0021b2ad2d5692 2023-03-28 05:55:20,486 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in df36b35bd32c0c4727983225bdf25a02/family1 of df36b35bd32c0c4727983225bdf25a02 into 8b79b0d14bfa4fa08e0021b2ad2d5692(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:20,486 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:55:20,486 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1679982919608; duration=0sec 2023-03-28 05:55:20,486 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:55:20,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5146126471d645c8908596ebb9746f58, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-345031e3a72c44f7a4ca76b4f80d6012, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-b544dffd423f459bbd078c742b997656, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-fcb5518b3b7b4a10bf9b0076f2b47182, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_] to archive 2023-03-28 05:55:20,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:20,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5146126471d645c8908596ebb9746f58 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5146126471d645c8908596ebb9746f58 2023-03-28 05:55:20,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-345031e3a72c44f7a4ca76b4f80d6012 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-345031e3a72c44f7a4ca76b4f80d6012 2023-03-28 05:55:20,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-b544dffd423f459bbd078c742b997656 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-b544dffd423f459bbd078c742b997656 2023-03-28 05:55:20,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-fcb5518b3b7b4a10bf9b0076f2b47182 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-fcb5518b3b7b4a10bf9b0076f2b47182 2023-03-28 05:55:20,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family1/a4bc946c5538425e81cfb0ac2e5694d0_SeqId_34_ 2023-03-28 05:55:20,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5396d89c753848b48bd06195dce49392, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-767fecffbc63478b9f4fd5eaf0575c77, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-cded5e69144f441ca8d26234d49134c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-328e6331386b47a4b9a6d403da8c9e11] to archive 2023-03-28 05:55:20,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:20,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5396d89c753848b48bd06195dce49392 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-5396d89c753848b48bd06195dce49392 2023-03-28 05:55:20,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-767fecffbc63478b9f4fd5eaf0575c77 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-767fecffbc63478b9f4fd5eaf0575c77 2023-03-28 05:55:20,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-cded5e69144f441ca8d26234d49134c0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-cded5e69144f441ca8d26234d49134c0 2023-03-28 05:55:20,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-328e6331386b47a4b9a6d403da8c9e11 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/family2/testCompactionWithHFileLink=df36b35bd32c0c4727983225bdf25a02-328e6331386b47a4b9a6d403da8c9e11 2023-03-28 05:55:20,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76bc919d1afa95f1382595342810654d, NAME => 'ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d.', STARTKEY => '', ENDKEY => '1'} 2023-03-28 05:55:20,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:20,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,574 INFO [StoreOpener-76bc919d1afa95f1382595342810654d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,575 DEBUG [StoreOpener-76bc919d1afa95f1382595342810654d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1 2023-03-28 05:55:20,575 DEBUG [StoreOpener-76bc919d1afa95f1382595342810654d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1 2023-03-28 05:55:20,576 INFO [StoreOpener-76bc919d1afa95f1382595342810654d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76bc919d1afa95f1382595342810654d columnFamilyName family1 2023-03-28 05:55:20,577 INFO [StoreOpener-76bc919d1afa95f1382595342810654d-1] regionserver.HStore(310): Store=76bc919d1afa95f1382595342810654d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:20,577 INFO [StoreOpener-76bc919d1afa95f1382595342810654d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,578 DEBUG [StoreOpener-76bc919d1afa95f1382595342810654d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2 2023-03-28 05:55:20,578 DEBUG [StoreOpener-76bc919d1afa95f1382595342810654d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2 2023-03-28 05:55:20,579 INFO [StoreOpener-76bc919d1afa95f1382595342810654d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76bc919d1afa95f1382595342810654d columnFamilyName family2 2023-03-28 05:55:20,580 INFO [StoreOpener-76bc919d1afa95f1382595342810654d-1] regionserver.HStore(310): Store=76bc919d1afa95f1382595342810654d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:20,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:20,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76bc919d1afa95f1382595342810654d 2023-03-28 05:55:20,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:55:20,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76bc919d1afa95f1382595342810654d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60486344, jitterRate=-0.09868323802947998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:20,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:20,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d., pid=109, masterSystemTime=1679982920570 2023-03-28 05:55:20,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d9e2d69c8fe93609783c176a23cd793, NAME => 'ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793.', STARTKEY => '2', ENDKEY => ''} 2023-03-28 05:55:20,589 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=76bc919d1afa95f1382595342810654d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:20,589 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679982920589"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982920589"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982920589"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982920589"}]},"ts":"1679982920589"} 2023-03-28 05:55:20,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,590 INFO [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-03-28 05:55:20,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 76bc919d1afa95f1382595342810654d, server=jenkins-hbase4.apache.org,39167,1679982818904 in 172 msec 2023-03-28 05:55:20,592 DEBUG [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1 2023-03-28 05:55:20,592 DEBUG [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1 2023-03-28 05:55:20,592 INFO [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d9e2d69c8fe93609783c176a23cd793 columnFamilyName family1 2023-03-28 05:55:20,593 INFO [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] regionserver.HStore(310): Store=2d9e2d69c8fe93609783c176a23cd793/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:20,593 INFO [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=76bc919d1afa95f1382595342810654d, ASSIGN in 332 msec 2023-03-28 05:55:20,595 DEBUG [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2 2023-03-28 05:55:20,595 DEBUG [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2 2023-03-28 05:55:20,596 INFO [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d9e2d69c8fe93609783c176a23cd793 columnFamilyName family2 2023-03-28 05:55:20,597 INFO [StoreOpener-2d9e2d69c8fe93609783c176a23cd793-1] regionserver.HStore(310): Store=2d9e2d69c8fe93609783c176a23cd793/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:20,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:20,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:55:20,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:55:20,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d9e2d69c8fe93609783c176a23cd793; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72648476, jitterRate=0.0825466513633728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:20,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:20,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793., pid=110, masterSystemTime=1679982920570 2023-03-28 05:55:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5f52d0654050f53e3182942577dbeea, NAME => 'ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea.', STARTKEY => '1', ENDKEY => '2'} 2023-03-28 05:55:20,604 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=2d9e2d69c8fe93609783c176a23cd793, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,604 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679982920604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982920604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982920604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982920604"}]},"ts":"1679982920604"} 2023-03-28 05:55:20,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:20,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,606 INFO [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-03-28 05:55:20,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 2d9e2d69c8fe93609783c176a23cd793, server=jenkins-hbase4.apache.org,39167,1679982818904 in 188 msec 2023-03-28 05:55:20,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2d9e2d69c8fe93609783c176a23cd793, ASSIGN in 347 msec 2023-03-28 05:55:20,609 DEBUG [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1 2023-03-28 05:55:20,609 DEBUG [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1 2023-03-28 05:55:20,609 INFO [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f52d0654050f53e3182942577dbeea columnFamilyName family1 2023-03-28 05:55:20,610 INFO [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] regionserver.HStore(310): Store=e5f52d0654050f53e3182942577dbeea/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:20,610 INFO [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,611 DEBUG [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2 2023-03-28 05:55:20,611 DEBUG [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2 2023-03-28 05:55:20,611 INFO [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f52d0654050f53e3182942577dbeea columnFamilyName family2 2023-03-28 05:55:20,612 INFO [StoreOpener-e5f52d0654050f53e3182942577dbeea-1] regionserver.HStore(310): Store=e5f52d0654050f53e3182942577dbeea/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:20,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:20,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e5f52d0654050f53e3182942577dbeea 2023-03-28 05:55:20,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:55:20,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e5f52d0654050f53e3182942577dbeea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67671826, jitterRate=0.008388787508010864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:20,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:20,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea., pid=111, masterSystemTime=1679982920570 2023-03-28 05:55:20,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e5f52d0654050f53e3182942577dbeea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,618 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679982920618"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982920618"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982920618"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982920618"}]},"ts":"1679982920618"} 2023-03-28 05:55:20,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-03-28 05:55:20,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure e5f52d0654050f53e3182942577dbeea, server=jenkins-hbase4.apache.org,39167,1679982818904 in 200 msec 2023-03-28 05:55:20,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-03-28 05:55:20,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e5f52d0654050f53e3182942577dbeea, ASSIGN in 361 msec 2023-03-28 05:55:20,622 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:55:20,623 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982920623"}]},"ts":"1679982920623"} 2023-03-28 05:55:20,624 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-28 05:55:20,628 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:55:20,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 824 msec 2023-03-28 05:55:20,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-28 05:55:20,911 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-28 05:55:20,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:20,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:20,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:20,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:20,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-28 05:55:20,931 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-28 05:55:20,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:20,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-28 05:55:20,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-28 05:55:20,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:20,932 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:20,933 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:20,933 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:20,934 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:20,934 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:20,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:20,935 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-28 05:55:20,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-28 05:55:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-28 05:55:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-28 05:55:20,936 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:20,936 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. started... 2023-03-28 05:55:20,936 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:20,936 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. started... 2023-03-28 05:55:20,942 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:20,942 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:20,942 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2d9e2d69c8fe93609783c176a23cd793 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:55:20,942 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:20,942 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. started... 2023-03-28 05:55:20,942 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5f52d0654050f53e3182942577dbeea 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:55:20,942 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bc919d1afa95f1382595342810654d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:55:21,382 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328b226702a1a98400eb1dc5d87b5481bac to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230328b226702a1a98400eb1dc5d87b5481bac 2023-03-28 05:55:21,385 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328c86f5453ddc245278d07b8169b251f7d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230328c86f5453ddc245278d07b8169b251f7d 2023-03-28 05:55:21,388 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/3a2cd3650f874fac9fad6661b66605e9 2023-03-28 05:55:21,392 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/44f3382a8a394c5b9cf359870f1ee51a 2023-03-28 05:55:21,398 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032891b62afa9b8d41f9a291f6d9911b599e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023032891b62afa9b8d41f9a291f6d9911b599e 2023-03-28 05:55:21,427 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328eaa889c0efa5434b834a1004f9b80a3d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230328eaa889c0efa5434b834a1004f9b80a3d 2023-03-28 05:55:21,435 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/5fececc73ee84efcb96f4e754256c3d8 2023-03-28 05:55:21,439 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/3a2cd3650f874fac9fad6661b66605e9 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/3a2cd3650f874fac9fad6661b66605e9 2023-03-28 05:55:21,443 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/3a2cd3650f874fac9fad6661b66605e9, entries=4, sequenceid=5, filesize=5.4 K 2023-03-28 05:55:21,444 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/5fececc73ee84efcb96f4e754256c3d8 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/5fececc73ee84efcb96f4e754256c3d8 2023-03-28 05:55:21,449 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/5fececc73ee84efcb96f4e754256c3d8, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:55:21,449 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2d9e2d69c8fe93609783c176a23cd793 in 507ms, sequenceid=5, compaction requested=false 2023-03-28 05:55:21,450 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-28 05:55:21,450 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:21,450 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:21,450 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:21,814 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/2532cd5b472b4b7db018bdde94631c58 2023-03-28 05:55:21,852 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303287da507861042476ea38384a73c799afb to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303287da507861042476ea38384a73c799afb 2023-03-28 05:55:21,865 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/4daf5ce1129341f9b26882137a7151ca 2023-03-28 05:55:21,868 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328f108ba5167264a35903556aac4a7c123 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230328f108ba5167264a35903556aac4a7c123 2023-03-28 05:55:21,873 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/44f3382a8a394c5b9cf359870f1ee51a as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/44f3382a8a394c5b9cf359870f1ee51a 2023-03-28 05:55:21,878 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/44f3382a8a394c5b9cf359870f1ee51a, entries=4, sequenceid=5, filesize=5.4 K 2023-03-28 05:55:21,879 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/4daf5ce1129341f9b26882137a7151ca as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/4daf5ce1129341f9b26882137a7151ca 2023-03-28 05:55:21,883 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/4daf5ce1129341f9b26882137a7151ca, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:55:21,884 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 76bc919d1afa95f1382595342810654d in 942ms, sequenceid=5, compaction requested=false 2023-03-28 05:55:21,885 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:21,885 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:21,885 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:22,290 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/7616cbc8e4e8413eb8e7d44aa1530328 2023-03-28 05:55:22,294 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/2532cd5b472b4b7db018bdde94631c58 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/2532cd5b472b4b7db018bdde94631c58 2023-03-28 05:55:22,298 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/2532cd5b472b4b7db018bdde94631c58, entries=4, sequenceid=5, filesize=5.4 K 2023-03-28 05:55:22,299 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/7616cbc8e4e8413eb8e7d44aa1530328 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/7616cbc8e4e8413eb8e7d44aa1530328 2023-03-28 05:55:22,303 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/7616cbc8e4e8413eb8e7d44aa1530328, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:55:22,303 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e5f52d0654050f53e3182942577dbeea in 1361ms, sequenceid=5, compaction requested=false 2023-03-28 05:55:22,303 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:22,304 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:22,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:22,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:22,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-28 05:55:22,304 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-28 05:55:22,305 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,305 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:22,306 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,306 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:22,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:22,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-28 05:55:22,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10070fe0[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:22,308 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-28 05:55:22,308 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,309 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-28 05:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-28 05:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:22,309 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,309 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:22,312 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,312 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-28 05:55:22,312 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,312 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-28 05:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:22,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:22,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:22,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:22,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:22,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:22,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-28 05:55:22,314 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-28 05:55:22,315 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:22,315 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:22,315 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-28 05:55:22,315 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:22,316 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,316 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,316 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:22,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:22,317 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:22,318 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,320 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:22,320 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:22,320 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:22,320 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:22,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-28 05:55:22,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:22,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-28 05:55:22,321 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:22,321 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:22,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:22,321 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,321 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,321 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:22,321 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,321 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:22,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:22,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:22,321 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:22,422 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:22,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:22,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:22,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:22,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:22,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:22,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:22,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-28 05:55:22,428 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-28 05:55:22,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:22,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-28 05:55:22,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-28 05:55:22,429 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,429 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:22,430 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,430 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:22,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:22,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:22,430 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:22,430 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:22,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:22,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:22,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:22,431 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-28 05:55:22,431 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-28 05:55:22,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-28 05:55:22,431 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-28 05:55:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-28 05:55:22,432 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:22,432 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. started... 2023-03-28 05:55:22,432 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5f52d0654050f53e3182942577dbeea 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:55:22,433 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:22,433 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:22,433 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:22,433 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. started... 2023-03-28 05:55:22,433 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:22,433 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. started... 2023-03-28 05:55:22,433 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2d9e2d69c8fe93609783c176a23cd793 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:55:22,433 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bc919d1afa95f1382595342810654d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:55:22,463 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328bb36a5df99924ec0aa46097a7e74dfe8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230328bb36a5df99924ec0aa46097a7e74dfe8 2023-03-28 05:55:22,470 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4 2023-03-28 05:55:22,472 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328b1bfef2b9d7c42b1afa764dedfc5fd44 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230328b1bfef2b9d7c42b1afa764dedfc5fd44 2023-03-28 05:55:22,482 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/2c88db524a0f4e0bb5af71e1f7d69b0d 2023-03-28 05:55:22,857 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328076520520ff74a2590a060a1bf04a023 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230328076520520ff74a2590a060a1bf04a023 2023-03-28 05:55:22,917 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303287848e2546eb047b696759fce31bf7695 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303287848e2546eb047b696759fce31bf7695 2023-03-28 05:55:22,923 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/7aeb3e1810d8438cadd9d42ee8337ba4 2023-03-28 05:55:22,927 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328d6554904a5c3479a8b04c32790b36692 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230328d6554904a5c3479a8b04c32790b36692 2023-03-28 05:55:22,929 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4 2023-03-28 05:55:22,934 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4, entries=4, sequenceid=9, filesize=5.4 K 2023-03-28 05:55:22,935 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/7aeb3e1810d8438cadd9d42ee8337ba4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/7aeb3e1810d8438cadd9d42ee8337ba4 2023-03-28 05:55:22,943 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/7aeb3e1810d8438cadd9d42ee8337ba4, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:55:22,944 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2d9e2d69c8fe93609783c176a23cd793 in 511ms, sequenceid=9, compaction requested=false 2023-03-28 05:55:22,944 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:22,945 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:22,945 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:23,270 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/a8990d1fa8454a92a0a13403451e3745 2023-03-28 05:55:23,285 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303280e67787e78c84032b45db46440ddca17 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303280e67787e78c84032b45db46440ddca17 2023-03-28 05:55:23,290 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/d570183a547746f5b5c2d14caa6f824e 2023-03-28 05:55:23,294 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/a8990d1fa8454a92a0a13403451e3745 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/a8990d1fa8454a92a0a13403451e3745 2023-03-28 05:55:23,297 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/a8990d1fa8454a92a0a13403451e3745, entries=4, sequenceid=9, filesize=5.4 K 2023-03-28 05:55:23,298 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/d570183a547746f5b5c2d14caa6f824e as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/d570183a547746f5b5c2d14caa6f824e 2023-03-28 05:55:23,304 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/d570183a547746f5b5c2d14caa6f824e, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:55:23,305 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e5f52d0654050f53e3182942577dbeea in 873ms, sequenceid=9, compaction requested=false 2023-03-28 05:55:23,305 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:23,305 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:23,305 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:23,367 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/1fb4dacf80184e318720c78a55c525a4 2023-03-28 05:55:23,371 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/2c88db524a0f4e0bb5af71e1f7d69b0d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/2c88db524a0f4e0bb5af71e1f7d69b0d 2023-03-28 05:55:23,375 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/2c88db524a0f4e0bb5af71e1f7d69b0d, entries=4, sequenceid=9, filesize=5.4 K 2023-03-28 05:55:23,375 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/1fb4dacf80184e318720c78a55c525a4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/1fb4dacf80184e318720c78a55c525a4 2023-03-28 05:55:23,380 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/1fb4dacf80184e318720c78a55c525a4, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:55:23,381 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 76bc919d1afa95f1382595342810654d in 948ms, sequenceid=9, compaction requested=false 2023-03-28 05:55:23,381 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:23,381 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-28 05:55:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-28 05:55:23,384 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,385 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:23,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:23,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:23,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-28 05:55:23,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a079c48[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:23,386 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-28 05:55:23,387 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,388 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-28 05:55:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-28 05:55:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:23,388 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,388 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:23,393 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,393 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-28 05:55:23,393 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:23,393 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-28 05:55:23,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:23,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-28 05:55:23,396 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-28 05:55:23,396 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:23,396 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:23,396 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-28 05:55:23,396 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:23,397 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,397 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:23,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,397 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:23,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:23,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:23,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:23,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:23,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,400 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:23,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:23,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:23,402 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:23,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:23,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:23,405 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:23,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-28 05:55:23,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-28 05:55:23,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:23,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:23,405 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:23,406 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:23,485 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:55:23,506 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:23,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:23,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:23,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:23,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:23,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:23,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:23,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-28 05:55:23,524 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-28 05:55:23,524 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:23,524 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-28 05:55:23,524 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-28 05:55:23,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:23,528 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,528 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:23,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:23,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:23,528 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:23,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:23,528 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:23,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:23,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:23,529 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-28 05:55:23,529 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-28 05:55:23,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-28 05:55:23,529 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-28 05:55:23,529 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:23,529 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-28 05:55:23,530 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:23,530 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. started... 2023-03-28 05:55:23,530 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:23,530 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:23,530 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:23,530 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:23,530 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. started... 2023-03-28 05:55:23,530 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5f52d0654050f53e3182942577dbeea 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:55:23,530 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. started... 2023-03-28 05:55:23,530 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2d9e2d69c8fe93609783c176a23cd793 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:55:23,530 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bc919d1afa95f1382595342810654d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:55:23,572 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328e9d19d9c2512453e8a693ab9be65e933 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230328e9d19d9c2512453e8a693ab9be65e933 2023-03-28 05:55:23,583 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/ad72e7ee78c342c68c9dad5c98ebb523 2023-03-28 05:55:23,605 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032877ba18e0158444bcbfe23fca67cc05bb to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023032877ba18e0158444bcbfe23fca67cc05bb 2023-03-28 05:55:23,965 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328437e908c52634cb98fcabd4d0f9e7ce7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230328437e908c52634cb98fcabd4d0f9e7ce7 2023-03-28 05:55:23,973 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328039970295b484416b5223940c01b1f30 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230328039970295b484416b5223940c01b1f30 2023-03-28 05:55:23,978 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/31c2c7f46af14e6691e95d17df11e2f9 2023-03-28 05:55:24,010 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/101d66924b9d48fcac9823ac34a6d2ec 2023-03-28 05:55:24,014 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/ad72e7ee78c342c68c9dad5c98ebb523 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/ad72e7ee78c342c68c9dad5c98ebb523 2023-03-28 05:55:24,018 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/ad72e7ee78c342c68c9dad5c98ebb523, entries=4, sequenceid=13, filesize=5.4 K 2023-03-28 05:55:24,018 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/101d66924b9d48fcac9823ac34a6d2ec as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/101d66924b9d48fcac9823ac34a6d2ec 2023-03-28 05:55:24,021 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/101d66924b9d48fcac9823ac34a6d2ec, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:55:24,022 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e5f52d0654050f53e3182942577dbeea in 492ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:24,022 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:24,022 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:24,022 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:24,371 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/1da9f14c79c34dd98ae87e984bdafa23 2023-03-28 05:55:24,384 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032815b25ed401534cb780a8b541191e0904 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023032815b25ed401534cb780a8b541191e0904 2023-03-28 05:55:24,390 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328a6944490ede240d4abc265304dbca162 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230328a6944490ede240d4abc265304dbca162 2023-03-28 05:55:24,390 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/5012806514db49169ebc96aa5cf27031 2023-03-28 05:55:24,396 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/1da9f14c79c34dd98ae87e984bdafa23 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/1da9f14c79c34dd98ae87e984bdafa23 2023-03-28 05:55:24,397 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/2f72b47cca974443b51cf32dc9efa2c0 2023-03-28 05:55:24,403 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/1da9f14c79c34dd98ae87e984bdafa23, entries=4, sequenceid=13, filesize=5.4 K 2023-03-28 05:55:24,404 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/31c2c7f46af14e6691e95d17df11e2f9 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/31c2c7f46af14e6691e95d17df11e2f9 2023-03-28 05:55:24,404 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/5012806514db49169ebc96aa5cf27031 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/5012806514db49169ebc96aa5cf27031 2023-03-28 05:55:24,408 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/31c2c7f46af14e6691e95d17df11e2f9, entries=4, sequenceid=13, filesize=5.4 K 2023-03-28 05:55:24,409 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/2f72b47cca974443b51cf32dc9efa2c0 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/2f72b47cca974443b51cf32dc9efa2c0 2023-03-28 05:55:24,409 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/5012806514db49169ebc96aa5cf27031, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:55:24,410 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 76bc919d1afa95f1382595342810654d in 880ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:24,410 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:24,410 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:24,410 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:24,413 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/2f72b47cca974443b51cf32dc9efa2c0, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:55:24,414 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2d9e2d69c8fe93609783c176a23cd793 in 884ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:24,414 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:24,414 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-28 05:55:24,414 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-28 05:55:24,416 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:24,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-28 05:55:24,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27ce78dc[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:24,420 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-28 05:55:24,420 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,421 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-28 05:55:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-28 05:55:24,421 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:24,421 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,421 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-28 05:55:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:24,423 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,423 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-28 05:55:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:24,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-28 05:55:24,426 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-28 05:55:24,426 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:24,426 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:24,426 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-28 05:55:24,426 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:24,429 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,430 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,430 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:24,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:24,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:24,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:24,430 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:24,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:24,431 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,435 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:24,435 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:24,435 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-28 05:55:24,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-28 05:55:24,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:24,436 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:24,436 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:24,436 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:24,436 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:24,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:24,436 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:24,437 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,437 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,437 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:24,437 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:24,536 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:24,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:24,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:24,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:24,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:24,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:24,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:24,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-28 05:55:24,543 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-28 05:55:24,543 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:24,543 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-28 05:55:24,543 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-28 05:55:24,544 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,544 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:24,545 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:24,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:24,545 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:24,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:24,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:24,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:24,547 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-28 05:55:24,547 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-28 05:55:24,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-28 05:55:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-28 05:55:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:24,547 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-28 05:55:24,547 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:24,548 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. started... 2023-03-28 05:55:24,548 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:24,548 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:24,548 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:24,548 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. started... 2023-03-28 05:55:24,548 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:24,548 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5f52d0654050f53e3182942577dbeea 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:24,548 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. started... 2023-03-28 05:55:24,548 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bc919d1afa95f1382595342810654d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:24,548 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2d9e2d69c8fe93609783c176a23cd793 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:24,987 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303286129095f26ed44569b051e160843493e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303286129095f26ed44569b051e160843493e 2023-03-28 05:55:24,990 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032801eeb4f9d91d4219a937da8c3c580d53 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023032801eeb4f9d91d4219a937da8c3c580d53 2023-03-28 05:55:24,997 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328b674fb304b164917a4b318409f273e8e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230328b674fb304b164917a4b318409f273e8e 2023-03-28 05:55:25,397 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/480a167b4dac41e594639f7d17100700 2023-03-28 05:55:25,397 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/fc7e7620c49946f889459a4282bf0a1c 2023-03-28 05:55:25,412 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/c10cf4522a73438d969fc6403fa6d5f7 2023-03-28 05:55:25,421 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328fa3875e7d4674a54b47938fb3d0ac0c9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230328fa3875e7d4674a54b47938fb3d0ac0c9 2023-03-28 05:55:25,440 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328d2469bce76db4af1a1855a97bf339b95 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230328d2469bce76db4af1a1855a97bf339b95 2023-03-28 05:55:25,445 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/edd2990b4eb74c82aa157d58eace6899 2023-03-28 05:55:25,451 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/c10cf4522a73438d969fc6403fa6d5f7 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/c10cf4522a73438d969fc6403fa6d5f7 2023-03-28 05:55:25,454 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/c10cf4522a73438d969fc6403fa6d5f7, entries=4, sequenceid=17, filesize=5.4 K 2023-03-28 05:55:25,456 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/edd2990b4eb74c82aa157d58eace6899 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/edd2990b4eb74c82aa157d58eace6899 2023-03-28 05:55:25,460 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/edd2990b4eb74c82aa157d58eace6899, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:25,461 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 76bc919d1afa95f1382595342810654d in 913ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:25,461 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:25,461 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:25,461 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:25,827 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/55d8e60012954d559cf00251d10f9b3a 2023-03-28 05:55:25,828 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303288201532591914efc813fd32e338de304 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303288201532591914efc813fd32e338de304 2023-03-28 05:55:25,832 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/fc7e7620c49946f889459a4282bf0a1c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/fc7e7620c49946f889459a4282bf0a1c 2023-03-28 05:55:25,837 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/fc7e7620c49946f889459a4282bf0a1c, entries=4, sequenceid=17, filesize=5.4 K 2023-03-28 05:55:25,839 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/55d8e60012954d559cf00251d10f9b3a as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/55d8e60012954d559cf00251d10f9b3a 2023-03-28 05:55:25,843 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/55d8e60012954d559cf00251d10f9b3a, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:25,844 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2d9e2d69c8fe93609783c176a23cd793 in 1296ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:25,844 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:25,844 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:25,844 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:26,235 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/b38b15e3609749528383855c983bbdfe 2023-03-28 05:55:26,240 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/480a167b4dac41e594639f7d17100700 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/480a167b4dac41e594639f7d17100700 2023-03-28 05:55:26,243 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/480a167b4dac41e594639f7d17100700, entries=4, sequenceid=17, filesize=5.4 K 2023-03-28 05:55:26,244 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/b38b15e3609749528383855c983bbdfe as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/b38b15e3609749528383855c983bbdfe 2023-03-28 05:55:26,247 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/b38b15e3609749528383855c983bbdfe, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:26,249 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e5f52d0654050f53e3182942577dbeea in 1701ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:26,249 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:26,250 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-28 05:55:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-28 05:55:26,251 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,251 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:26,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:26,252 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,252 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:26,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:26,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:26,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:26,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:26,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-28 05:55:26,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b205f7f[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:26,253 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-28 05:55:26,253 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,254 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,254 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-28 05:55:26,254 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-28 05:55:26,254 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:26,254 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,255 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-28 05:55:26,257 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:26,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:26,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-28 05:55:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:26,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:26,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-28 05:55:26,259 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-28 05:55:26,260 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:26,260 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:26,260 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-28 05:55:26,260 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:26,261 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,261 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:26,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:26,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,261 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:26,262 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:26,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:26,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:26,263 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:26,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:26,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:26,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:26,265 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:26,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-28 05:55:26,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:26,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:26,266 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:26,266 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:26,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-28 05:55:26,366 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:26,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:26,380 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:26,390 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:26,401 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:26,402 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:26,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-28 05:55:26,441 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-28 05:55:26,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:26,442 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-28 05:55:26,442 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-28 05:55:26,442 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,442 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:26,443 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:26,443 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:26,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:26,444 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:26,444 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:26,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:26,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-28 05:55:26,448 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-28 05:55:26,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-28 05:55:26,448 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-28 05:55:26,448 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:26,448 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-28 05:55:26,448 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:26,448 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. started... 2023-03-28 05:55:26,448 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5f52d0654050f53e3182942577dbeea 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:26,450 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:26,450 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. started... 2023-03-28 05:55:26,450 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2d9e2d69c8fe93609783c176a23cd793 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:26,450 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:26,451 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:26,451 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:26,451 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. started... 2023-03-28 05:55:26,451 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bc919d1afa95f1382595342810654d 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:26,532 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/4cfc5e080033478d9fd7b221256f8951 2023-03-28 05:55:26,534 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/ef27aaa6c7214c5d842194f0c32e2390 2023-03-28 05:55:26,538 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cfc5e080033478d9fd7b221256f8951 2023-03-28 05:55:26,541 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef27aaa6c7214c5d842194f0c32e2390 2023-03-28 05:55:26,961 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/f5a0476b7ebf438bbc3b717237cd6b98 2023-03-28 05:55:26,964 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5a0476b7ebf438bbc3b717237cd6b98 2023-03-28 05:55:26,965 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/4cfc5e080033478d9fd7b221256f8951 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/4cfc5e080033478d9fd7b221256f8951 2023-03-28 05:55:26,968 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4cfc5e080033478d9fd7b221256f8951 2023-03-28 05:55:26,968 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/4cfc5e080033478d9fd7b221256f8951, entries=3, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:26,969 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/f5a0476b7ebf438bbc3b717237cd6b98 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/f5a0476b7ebf438bbc3b717237cd6b98 2023-03-28 05:55:26,973 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5a0476b7ebf438bbc3b717237cd6b98 2023-03-28 05:55:26,973 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/f5a0476b7ebf438bbc3b717237cd6b98, entries=1, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:26,974 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e5f52d0654050f53e3182942577dbeea in 526ms, sequenceid=23, compaction requested=true 2023-03-28 05:55:26,974 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:26,974 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:26,974 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:26,988 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/4ffd9f81358c491980fe651a49ba0f3c 2023-03-28 05:55:26,992 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ffd9f81358c491980fe651a49ba0f3c 2023-03-28 05:55:26,993 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/ef27aaa6c7214c5d842194f0c32e2390 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/ef27aaa6c7214c5d842194f0c32e2390 2023-03-28 05:55:26,998 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef27aaa6c7214c5d842194f0c32e2390 2023-03-28 05:55:26,998 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/ef27aaa6c7214c5d842194f0c32e2390, entries=3, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:26,999 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/4ffd9f81358c491980fe651a49ba0f3c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/4ffd9f81358c491980fe651a49ba0f3c 2023-03-28 05:55:27,004 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ffd9f81358c491980fe651a49ba0f3c 2023-03-28 05:55:27,004 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/4ffd9f81358c491980fe651a49ba0f3c, entries=1, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:27,005 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2d9e2d69c8fe93609783c176a23cd793 in 555ms, sequenceid=23, compaction requested=true 2023-03-28 05:55:27,005 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:27,005 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:27,005 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:27,327 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/ba092c0921bb4a25a581409598f28f72 2023-03-28 05:55:27,331 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba092c0921bb4a25a581409598f28f72 2023-03-28 05:55:27,742 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/547c742ef78649679714898b722ecbfa 2023-03-28 05:55:27,747 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 547c742ef78649679714898b722ecbfa 2023-03-28 05:55:27,747 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/ba092c0921bb4a25a581409598f28f72 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/ba092c0921bb4a25a581409598f28f72 2023-03-28 05:55:27,751 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba092c0921bb4a25a581409598f28f72 2023-03-28 05:55:27,751 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/ba092c0921bb4a25a581409598f28f72, entries=3, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:27,752 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/547c742ef78649679714898b722ecbfa as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/547c742ef78649679714898b722ecbfa 2023-03-28 05:55:27,763 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 547c742ef78649679714898b722ecbfa 2023-03-28 05:55:27,763 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/547c742ef78649679714898b722ecbfa, entries=1, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:27,764 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 76bc919d1afa95f1382595342810654d in 1313ms, sequenceid=23, compaction requested=true 2023-03-28 05:55:27,764 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:27,764 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:27,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:27,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:27,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-28 05:55:27,764 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-28 05:55:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,766 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:27,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:27,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-28 05:55:27,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@237039f4[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:27,768 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-28 05:55:27,768 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,771 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,771 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:27,771 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,772 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-28 05:55:27,772 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-28 05:55:27,772 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:27,777 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-28 05:55:27,777 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:27,777 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-28 05:55:27,777 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:27,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:27,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:27,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:27,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:27,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-28 05:55:27,782 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-28 05:55:27,782 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:27,782 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:27,782 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-28 05:55:27,782 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:27,784 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:27,784 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:27,784 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:27,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:27,784 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:27,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:27,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:27,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:27,787 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:27,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:27,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-28 05:55:27,789 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,789 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:27,789 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-28 05:55:27,789 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:27,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-28 05:55:27,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:27,789 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,789 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:27,790 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:27,789 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:27,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:27,790 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-28 05:55:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:27,790 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:27,790 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:27,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-28 05:55:27,790 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-28 05:55:27,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:27,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:27,890 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:27,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:27,891 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:27,892 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): e5f52d0654050f53e3182942577dbeea/family1 is initiating major compaction (all files) 2023-03-28 05:55:27,892 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:27,892 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:27,892 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of e5f52d0654050f53e3182942577dbeea/family1 in ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:27,892 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/2532cd5b472b4b7db018bdde94631c58, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/a8990d1fa8454a92a0a13403451e3745, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/ad72e7ee78c342c68c9dad5c98ebb523, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/480a167b4dac41e594639f7d17100700, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/4cfc5e080033478d9fd7b221256f8951] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp, totalSize=26.6 K 2023-03-28 05:55:27,893 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 2532cd5b472b4b7db018bdde94631c58, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982920923 2023-03-28 05:55:27,893 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting a8990d1fa8454a92a0a13403451e3745, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982922424 2023-03-28 05:55:27,894 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting ad72e7ee78c342c68c9dad5c98ebb523, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982923509 2023-03-28 05:55:27,894 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 480a167b4dac41e594639f7d17100700, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982924539 2023-03-28 05:55:27,895 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 4cfc5e080033478d9fd7b221256f8951, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:27,911 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): e5f52d0654050f53e3182942577dbeea#family1#compaction#150 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:27,932 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328a674845eb6c1401ca4c39190727c6cc6_del 2023-03-28 05:55:27,932 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328a674845eb6c1401ca4c39190727c6cc6_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230328a674845eb6c1401ca4c39190727c6cc6_del 2023-03-28 05:55:28,346 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4eaddfe42e84489592a9efe7a275465a 2023-03-28 05:55:28,347 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family1/4eaddfe42e84489592a9efe7a275465a as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/4eaddfe42e84489592a9efe7a275465a 2023-03-28 05:55:28,350 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4eaddfe42e84489592a9efe7a275465a 2023-03-28 05:55:28,351 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e5f52d0654050f53e3182942577dbeea/family1 of e5f52d0654050f53e3182942577dbeea into 4eaddfe42e84489592a9efe7a275465a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:28,351 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:28,352 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:28,352 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): e5f52d0654050f53e3182942577dbeea/family2 is initiating major compaction (all files) 2023-03-28 05:55:28,352 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:28,352 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:28,352 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of e5f52d0654050f53e3182942577dbeea/family2 in ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:55:28,352 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/7616cbc8e4e8413eb8e7d44aa1530328, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/d570183a547746f5b5c2d14caa6f824e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/101d66924b9d48fcac9823ac34a6d2ec, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/b38b15e3609749528383855c983bbdfe, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/f5a0476b7ebf438bbc3b717237cd6b98] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp, totalSize=25.3 K 2023-03-28 05:55:28,353 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 7616cbc8e4e8413eb8e7d44aa1530328, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982920923 2023-03-28 05:55:28,353 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting d570183a547746f5b5c2d14caa6f824e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982922424 2023-03-28 05:55:28,353 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 101d66924b9d48fcac9823ac34a6d2ec, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982923509 2023-03-28 05:55:28,354 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting b38b15e3609749528383855c983bbdfe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982924539 2023-03-28 05:55:28,354 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting f5a0476b7ebf438bbc3b717237cd6b98, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:28,363 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): e5f52d0654050f53e3182942577dbeea#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:28,373 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328fae04ff6e9b34e7780247ee90a237b78_del 2023-03-28 05:55:28,373 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328fae04ff6e9b34e7780247ee90a237b78_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230328fae04ff6e9b34e7780247ee90a237b78_del 2023-03-28 05:55:28,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/2532cd5b472b4b7db018bdde94631c58, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/a8990d1fa8454a92a0a13403451e3745, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/ad72e7ee78c342c68c9dad5c98ebb523, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/480a167b4dac41e594639f7d17100700, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/4cfc5e080033478d9fd7b221256f8951] to archive 2023-03-28 05:55:28,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:28,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/2532cd5b472b4b7db018bdde94631c58 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/2532cd5b472b4b7db018bdde94631c58 2023-03-28 05:55:28,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/a8990d1fa8454a92a0a13403451e3745 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/a8990d1fa8454a92a0a13403451e3745 2023-03-28 05:55:28,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/ad72e7ee78c342c68c9dad5c98ebb523 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/ad72e7ee78c342c68c9dad5c98ebb523 2023-03-28 05:55:28,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/480a167b4dac41e594639f7d17100700 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/480a167b4dac41e594639f7d17100700 2023-03-28 05:55:28,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/4cfc5e080033478d9fd7b221256f8951 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/4cfc5e080033478d9fd7b221256f8951 2023-03-28 05:55:28,788 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b798b2387c784c31ad65246be6458a74 2023-03-28 05:55:28,789 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/.tmp/family2/b798b2387c784c31ad65246be6458a74 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/b798b2387c784c31ad65246be6458a74 2023-03-28 05:55:28,795 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b798b2387c784c31ad65246be6458a74 2023-03-28 05:55:28,796 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e5f52d0654050f53e3182942577dbeea/family2 of e5f52d0654050f53e3182942577dbeea into b798b2387c784c31ad65246be6458a74(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:28,797 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:28,797 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:28,797 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 2d9e2d69c8fe93609783c176a23cd793/family1 is initiating major compaction (all files) 2023-03-28 05:55:28,797 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:28,797 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:28,797 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 2d9e2d69c8fe93609783c176a23cd793/family1 in ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:28,798 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/3a2cd3650f874fac9fad6661b66605e9, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/31c2c7f46af14e6691e95d17df11e2f9, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/fc7e7620c49946f889459a4282bf0a1c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/ef27aaa6c7214c5d842194f0c32e2390] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp, totalSize=26.6 K 2023-03-28 05:55:28,798 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 3a2cd3650f874fac9fad6661b66605e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982920924 2023-03-28 05:55:28,799 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 7d1a1f4f6efc42a7a20e5a1e8ea8e1e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982922424 2023-03-28 05:55:28,800 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 31c2c7f46af14e6691e95d17df11e2f9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982923509 2023-03-28 05:55:28,800 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting fc7e7620c49946f889459a4282bf0a1c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982924539 2023-03-28 05:55:28,801 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting ef27aaa6c7214c5d842194f0c32e2390, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:28,812 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 2d9e2d69c8fe93609783c176a23cd793#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:28,829 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230328be8ddc1a810d48849feef0a887f192c8_del 2023-03-28 05:55:28,829 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328be8ddc1a810d48849feef0a887f192c8_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230328be8ddc1a810d48849feef0a887f192c8_del 2023-03-28 05:55:28,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/7616cbc8e4e8413eb8e7d44aa1530328, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/d570183a547746f5b5c2d14caa6f824e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/101d66924b9d48fcac9823ac34a6d2ec, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/b38b15e3609749528383855c983bbdfe, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/f5a0476b7ebf438bbc3b717237cd6b98] to archive 2023-03-28 05:55:28,831 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:28,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/7616cbc8e4e8413eb8e7d44aa1530328 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/7616cbc8e4e8413eb8e7d44aa1530328 2023-03-28 05:55:28,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/d570183a547746f5b5c2d14caa6f824e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/d570183a547746f5b5c2d14caa6f824e 2023-03-28 05:55:28,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/101d66924b9d48fcac9823ac34a6d2ec to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/101d66924b9d48fcac9823ac34a6d2ec 2023-03-28 05:55:28,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/b38b15e3609749528383855c983bbdfe to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/b38b15e3609749528383855c983bbdfe 2023-03-28 05:55:28,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/f5a0476b7ebf438bbc3b717237cd6b98 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family2/f5a0476b7ebf438bbc3b717237cd6b98 2023-03-28 05:55:29,650 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15e0680765f945068a24f3f1267cabdc 2023-03-28 05:55:29,653 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family1/15e0680765f945068a24f3f1267cabdc as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/15e0680765f945068a24f3f1267cabdc 2023-03-28 05:55:29,664 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15e0680765f945068a24f3f1267cabdc 2023-03-28 05:55:29,665 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2d9e2d69c8fe93609783c176a23cd793/family1 of 2d9e2d69c8fe93609783c176a23cd793 into 15e0680765f945068a24f3f1267cabdc(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:29,665 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:29,665 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:29,665 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 2d9e2d69c8fe93609783c176a23cd793/family2 is initiating major compaction (all files) 2023-03-28 05:55:29,665 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:29,666 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:29,666 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 2d9e2d69c8fe93609783c176a23cd793/family2 in ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:55:29,666 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/5fececc73ee84efcb96f4e754256c3d8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/7aeb3e1810d8438cadd9d42ee8337ba4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/2f72b47cca974443b51cf32dc9efa2c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/55d8e60012954d559cf00251d10f9b3a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/4ffd9f81358c491980fe651a49ba0f3c] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp, totalSize=25.3 K 2023-03-28 05:55:29,669 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 5fececc73ee84efcb96f4e754256c3d8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982920924 2023-03-28 05:55:29,670 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 7aeb3e1810d8438cadd9d42ee8337ba4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982922424 2023-03-28 05:55:29,670 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 2f72b47cca974443b51cf32dc9efa2c0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982923509 2023-03-28 05:55:29,671 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 55d8e60012954d559cf00251d10f9b3a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982924539 2023-03-28 05:55:29,671 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 4ffd9f81358c491980fe651a49ba0f3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:29,686 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 2d9e2d69c8fe93609783c176a23cd793#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:29,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/3a2cd3650f874fac9fad6661b66605e9, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/31c2c7f46af14e6691e95d17df11e2f9, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/fc7e7620c49946f889459a4282bf0a1c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/ef27aaa6c7214c5d842194f0c32e2390] to archive 2023-03-28 05:55:29,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:29,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/3a2cd3650f874fac9fad6661b66605e9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/3a2cd3650f874fac9fad6661b66605e9 2023-03-28 05:55:29,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/7d1a1f4f6efc42a7a20e5a1e8ea8e1e4 2023-03-28 05:55:29,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/31c2c7f46af14e6691e95d17df11e2f9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/31c2c7f46af14e6691e95d17df11e2f9 2023-03-28 05:55:29,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/fc7e7620c49946f889459a4282bf0a1c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/fc7e7620c49946f889459a4282bf0a1c 2023-03-28 05:55:29,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/ef27aaa6c7214c5d842194f0c32e2390 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/ef27aaa6c7214c5d842194f0c32e2390 2023-03-28 05:55:30,094 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230328396274bf515a42709056006342ed5588_del 2023-03-28 05:55:30,094 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328396274bf515a42709056006342ed5588_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230328396274bf515a42709056006342ed5588_del 2023-03-28 05:55:30,508 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b58888033c9a449686041816f64760d7 2023-03-28 05:55:30,509 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/.tmp/family2/b58888033c9a449686041816f64760d7 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/b58888033c9a449686041816f64760d7 2023-03-28 05:55:30,513 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b58888033c9a449686041816f64760d7 2023-03-28 05:55:30,514 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2d9e2d69c8fe93609783c176a23cd793/family2 of 2d9e2d69c8fe93609783c176a23cd793 into b58888033c9a449686041816f64760d7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:30,514 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:30,515 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:30,515 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 76bc919d1afa95f1382595342810654d/family1 is initiating major compaction (all files) 2023-03-28 05:55:30,515 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:30,515 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:30,515 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 76bc919d1afa95f1382595342810654d/family1 in ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:30,515 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/44f3382a8a394c5b9cf359870f1ee51a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/2c88db524a0f4e0bb5af71e1f7d69b0d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/1da9f14c79c34dd98ae87e984bdafa23, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/c10cf4522a73438d969fc6403fa6d5f7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/ba092c0921bb4a25a581409598f28f72] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp, totalSize=26.6 K 2023-03-28 05:55:30,515 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 44f3382a8a394c5b9cf359870f1ee51a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982920923 2023-03-28 05:55:30,516 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 2c88db524a0f4e0bb5af71e1f7d69b0d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982922424 2023-03-28 05:55:30,516 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 1da9f14c79c34dd98ae87e984bdafa23, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982923508 2023-03-28 05:55:30,517 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting c10cf4522a73438d969fc6403fa6d5f7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982924538 2023-03-28 05:55:30,517 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting ba092c0921bb4a25a581409598f28f72, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:30,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/5fececc73ee84efcb96f4e754256c3d8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/7aeb3e1810d8438cadd9d42ee8337ba4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/2f72b47cca974443b51cf32dc9efa2c0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/55d8e60012954d559cf00251d10f9b3a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/4ffd9f81358c491980fe651a49ba0f3c] to archive 2023-03-28 05:55:30,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:30,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/5fececc73ee84efcb96f4e754256c3d8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/5fececc73ee84efcb96f4e754256c3d8 2023-03-28 05:55:30,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/7aeb3e1810d8438cadd9d42ee8337ba4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/7aeb3e1810d8438cadd9d42ee8337ba4 2023-03-28 05:55:30,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/2f72b47cca974443b51cf32dc9efa2c0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/2f72b47cca974443b51cf32dc9efa2c0 2023-03-28 05:55:30,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/55d8e60012954d559cf00251d10f9b3a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/55d8e60012954d559cf00251d10f9b3a 2023-03-28 05:55:30,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/4ffd9f81358c491980fe651a49ba0f3c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family2/4ffd9f81358c491980fe651a49ba0f3c 2023-03-28 05:55:30,546 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 76bc919d1afa95f1382595342810654d#family1#compaction#154 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:30,957 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023032806b5ac0b6f64486495b6b0f8734a5109_del 2023-03-28 05:55:30,958 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032806b5ac0b6f64486495b6b0f8734a5109_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023032806b5ac0b6f64486495b6b0f8734a5109_del 2023-03-28 05:55:31,383 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 862cd63289ba4d6ab84e7b091a8fee03 2023-03-28 05:55:31,384 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family1/862cd63289ba4d6ab84e7b091a8fee03 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/862cd63289ba4d6ab84e7b091a8fee03 2023-03-28 05:55:31,387 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 862cd63289ba4d6ab84e7b091a8fee03 2023-03-28 05:55:31,388 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 76bc919d1afa95f1382595342810654d/family1 of 76bc919d1afa95f1382595342810654d into 862cd63289ba4d6ab84e7b091a8fee03(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:31,389 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:31,389 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:31,389 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 76bc919d1afa95f1382595342810654d/family2 is initiating major compaction (all files) 2023-03-28 05:55:31,389 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:31,389 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:31,389 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 76bc919d1afa95f1382595342810654d/family2 in ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:55:31,389 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/4daf5ce1129341f9b26882137a7151ca, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/1fb4dacf80184e318720c78a55c525a4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/5012806514db49169ebc96aa5cf27031, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/edd2990b4eb74c82aa157d58eace6899, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/547c742ef78649679714898b722ecbfa] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp, totalSize=25.3 K 2023-03-28 05:55:31,390 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 4daf5ce1129341f9b26882137a7151ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982920923 2023-03-28 05:55:31,390 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 1fb4dacf80184e318720c78a55c525a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982922424 2023-03-28 05:55:31,390 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 5012806514db49169ebc96aa5cf27031, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982923508 2023-03-28 05:55:31,391 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting edd2990b4eb74c82aa157d58eace6899, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982924538 2023-03-28 05:55:31,391 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 547c742ef78649679714898b722ecbfa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:31,401 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 76bc919d1afa95f1382595342810654d#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:31,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/44f3382a8a394c5b9cf359870f1ee51a, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/2c88db524a0f4e0bb5af71e1f7d69b0d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/1da9f14c79c34dd98ae87e984bdafa23, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/c10cf4522a73438d969fc6403fa6d5f7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/ba092c0921bb4a25a581409598f28f72] to archive 2023-03-28 05:55:31,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:31,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/44f3382a8a394c5b9cf359870f1ee51a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/44f3382a8a394c5b9cf359870f1ee51a 2023-03-28 05:55:31,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/2c88db524a0f4e0bb5af71e1f7d69b0d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/2c88db524a0f4e0bb5af71e1f7d69b0d 2023-03-28 05:55:31,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/1da9f14c79c34dd98ae87e984bdafa23 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/1da9f14c79c34dd98ae87e984bdafa23 2023-03-28 05:55:31,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/c10cf4522a73438d969fc6403fa6d5f7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/c10cf4522a73438d969fc6403fa6d5f7 2023-03-28 05:55:31,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/ba092c0921bb4a25a581409598f28f72 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/ba092c0921bb4a25a581409598f28f72 2023-03-28 05:55:31,812 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230328449241fcd01b47fca0461b6045efb801_del 2023-03-28 05:55:31,812 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328449241fcd01b47fca0461b6045efb801_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230328449241fcd01b47fca0461b6045efb801_del 2023-03-28 05:55:32,638 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4f585dad22944efa11dec53bafbb769 2023-03-28 05:55:32,638 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/.tmp/family2/f4f585dad22944efa11dec53bafbb769 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/f4f585dad22944efa11dec53bafbb769 2023-03-28 05:55:32,641 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4f585dad22944efa11dec53bafbb769 2023-03-28 05:55:32,642 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 76bc919d1afa95f1382595342810654d/family2 of 76bc919d1afa95f1382595342810654d into f4f585dad22944efa11dec53bafbb769(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-28 05:55:32,642 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:32,647 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:32,650 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:32,653 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:32,654 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:32,659 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-28 05:55:32,674 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-28 05:55:32,677 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023032806b5ac0b6f64486495b6b0f8734a5109_del 2023-03-28 05:55:32,680 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328a674845eb6c1401ca4c39190727c6cc6_del 2023-03-28 05:55:32,683 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230328be8ddc1a810d48849feef0a887f192c8_del 2023-03-28 05:55:32,683 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:32,684 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(139): Connect 0x293644a6 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:55:32,689 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c9308, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:55:32,691 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230328 for table='ns:testMinorCompaction' and column='family1' 2023-03-28 05:55:32,691 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230328 for table='ns:testMinorCompaction' and column='family1' 2023-03-28 05:55:32,691 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230328 for table='ns:testMinorCompaction' and column='family1' 2023-03-28 05:55:32,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/4daf5ce1129341f9b26882137a7151ca, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/1fb4dacf80184e318720c78a55c525a4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/5012806514db49169ebc96aa5cf27031, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/edd2990b4eb74c82aa157d58eace6899, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/547c742ef78649679714898b722ecbfa] to archive 2023-03-28 05:55:32,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:32,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/4daf5ce1129341f9b26882137a7151ca to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/4daf5ce1129341f9b26882137a7151ca 2023-03-28 05:55:32,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/1fb4dacf80184e318720c78a55c525a4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/1fb4dacf80184e318720c78a55c525a4 2023-03-28 05:55:32,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/5012806514db49169ebc96aa5cf27031 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/5012806514db49169ebc96aa5cf27031 2023-03-28 05:55:32,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/edd2990b4eb74c82aa157d58eace6899 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/edd2990b4eb74c82aa157d58eace6899 2023-03-28 05:55:32,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/547c742ef78649679714898b722ecbfa to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family2/547c742ef78649679714898b722ecbfa 2023-03-28 05:55:33,165 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032899c74ac6d02246bfb90b571d84cd721f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023032899c74ac6d02246bfb90b571d84cd721f 2023-03-28 05:55:33,166 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:33,180 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:55:33,183 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:55:33,194 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:55:33,203 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:55:33,223 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/family1/a57409e78ae84e75982ff5d5283d9be4 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-28 05:55:33,224 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/family1/a57409e78ae84e75982ff5d5283d9be4}] 2023-03-28 05:55:33,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/family1/a57409e78ae84e75982ff5d5283d9be4 for inclusion in 76bc919d1afa95f1382595342810654d/family1 2023-03-28 05:55:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-28 05:55:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last=1 2023-03-28 05:55:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:55:33,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230328/family1/a57409e78ae84e75982ff5d5283d9be4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__noknrlb8gdqthfje762pds8kbael5m00lq4ebebguq97uleakgesk45m39sr8nqc/family1/a57409e78ae84e75982ff5d5283d9be4 2023-03-28 05:55:33,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__noknrlb8gdqthfje762pds8kbael5m00lq4ebebguq97uleakgesk45m39sr8nqc/family1/a57409e78ae84e75982ff5d5283d9be4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/093b22ce6a5b4fb7b7c13af2adddcb9d_SeqId_28_ 2023-03-28 05:55:33,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__noknrlb8gdqthfje762pds8kbael5m00lq4ebebguq97uleakgesk45m39sr8nqc/family1/a57409e78ae84e75982ff5d5283d9be4 into 76bc919d1afa95f1382595342810654d/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/093b22ce6a5b4fb7b7c13af2adddcb9d_SeqId_28_ - updating store file list. 2023-03-28 05:55:33,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/093b22ce6a5b4fb7b7c13af2adddcb9d_SeqId_28_ into 76bc919d1afa95f1382595342810654d/family1 2023-03-28 05:55:33,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__noknrlb8gdqthfje762pds8kbael5m00lq4ebebguq97uleakgesk45m39sr8nqc/family1/a57409e78ae84e75982ff5d5283d9be4 into 76bc919d1afa95f1382595342810654d/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/family1/093b22ce6a5b4fb7b7c13af2adddcb9d_SeqId_28_) 2023-03-28 05:55:33,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__noknrlb8gdqthfje762pds8kbael5m00lq4ebebguq97uleakgesk45m39sr8nqc/family1/a57409e78ae84e75982ff5d5283d9be4 2023-03-28 05:55:33,253 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:33,254 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:33,256 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230328c86f5453ddc245278d07b8169b251f7d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230328c86f5453ddc245278d07b8169b251f7d 2023-03-28 05:55:33,256 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-28 05:55:33,256 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230328' 2023-03-28 05:55:33,257 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230328 for table='ns:testMinorCompaction' and column='family1' 2023-03-28 05:55:33,561 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328ca8aba70fc2841b5b478c7415626599c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230328ca8aba70fc2841b5b478c7415626599c 2023-03-28 05:55:33,563 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:33,565 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328a25e11796f634563bbc6f4a5dbf25562 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230328a25e11796f634563bbc6f4a5dbf25562 2023-03-28 05:55:33,565 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:33,610 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230328/family1/c34ce25d66b342fd82c20a97d992e5b6 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-28 05:55:33,611 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230328/family1/c34ce25d66b342fd82c20a97d992e5b6}] 2023-03-28 05:55:33,611 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230328/family1/52432a8590fe4b849d3fc78997274e46 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-28 05:55:33,612 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230328/family1/52432a8590fe4b849d3fc78997274e46}] 2023-03-28 05:55:33,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230328/family1/c34ce25d66b342fd82c20a97d992e5b6 for inclusion in 2d9e2d69c8fe93609783c176a23cd793/family1 2023-03-28 05:55:33,615 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230328/family1/52432a8590fe4b849d3fc78997274e46 for inclusion in e5f52d0654050f53e3182942577dbeea/family1 2023-03-28 05:55:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-28 05:55:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-28 05:55:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-28 05:55:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-28 05:55:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:55:33,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:55:33,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230328/family1/52432a8590fe4b849d3fc78997274e46 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__q8pqf2rirdkn7jcr43mjl0bbt9sduhftuncljc4ql0l1cqcd5ced9u3ntte3mduv/family1/52432a8590fe4b849d3fc78997274e46 2023-03-28 05:55:33,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230328/family1/c34ce25d66b342fd82c20a97d992e5b6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__6sg2bi45bsmsu2vb7jod2nvkk8k6b9tb9p1i60aeilfr1jj5v85p5d320kjv48d0/family1/c34ce25d66b342fd82c20a97d992e5b6 2023-03-28 05:55:33,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__q8pqf2rirdkn7jcr43mjl0bbt9sduhftuncljc4ql0l1cqcd5ced9u3ntte3mduv/family1/52432a8590fe4b849d3fc78997274e46 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/363536bc2e7c4f579ea9aa3f3047d4e2_SeqId_28_ 2023-03-28 05:55:33,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__6sg2bi45bsmsu2vb7jod2nvkk8k6b9tb9p1i60aeilfr1jj5v85p5d320kjv48d0/family1/c34ce25d66b342fd82c20a97d992e5b6 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/769cbc04bcc540c7af42aa9641a389c3_SeqId_28_ 2023-03-28 05:55:33,623 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__q8pqf2rirdkn7jcr43mjl0bbt9sduhftuncljc4ql0l1cqcd5ced9u3ntte3mduv/family1/52432a8590fe4b849d3fc78997274e46 into e5f52d0654050f53e3182942577dbeea/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/363536bc2e7c4f579ea9aa3f3047d4e2_SeqId_28_ - updating store file list. 2023-03-28 05:55:33,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__6sg2bi45bsmsu2vb7jod2nvkk8k6b9tb9p1i60aeilfr1jj5v85p5d320kjv48d0/family1/c34ce25d66b342fd82c20a97d992e5b6 into 2d9e2d69c8fe93609783c176a23cd793/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/769cbc04bcc540c7af42aa9641a389c3_SeqId_28_ - updating store file list. 2023-03-28 05:55:33,627 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/363536bc2e7c4f579ea9aa3f3047d4e2_SeqId_28_ into e5f52d0654050f53e3182942577dbeea/family1 2023-03-28 05:55:33,627 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__q8pqf2rirdkn7jcr43mjl0bbt9sduhftuncljc4ql0l1cqcd5ced9u3ntte3mduv/family1/52432a8590fe4b849d3fc78997274e46 into e5f52d0654050f53e3182942577dbeea/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/family1/363536bc2e7c4f579ea9aa3f3047d4e2_SeqId_28_) 2023-03-28 05:55:33,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__q8pqf2rirdkn7jcr43mjl0bbt9sduhftuncljc4ql0l1cqcd5ced9u3ntte3mduv/family1/52432a8590fe4b849d3fc78997274e46 2023-03-28 05:55:33,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/769cbc04bcc540c7af42aa9641a389c3_SeqId_28_ into 2d9e2d69c8fe93609783c176a23cd793/family1 2023-03-28 05:55:33,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__6sg2bi45bsmsu2vb7jod2nvkk8k6b9tb9p1i60aeilfr1jj5v85p5d320kjv48d0/family1/c34ce25d66b342fd82c20a97d992e5b6 into 2d9e2d69c8fe93609783c176a23cd793/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/family1/769cbc04bcc540c7af42aa9641a389c3_SeqId_28_) 2023-03-28 05:55:33,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__ns_testMinorCompaction__6sg2bi45bsmsu2vb7jod2nvkk8k6b9tb9p1i60aeilfr1jj5v85p5d320kjv48d0/family1/c34ce25d66b342fd82c20a97d992e5b6 2023-03-28 05:55:33,630 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:33,631 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:33,632 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230328b226702a1a98400eb1dc5d87b5481bac to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230328b226702a1a98400eb1dc5d87b5481bac 2023-03-28 05:55:33,632 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-28 05:55:33,632 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230328' 2023-03-28 05:55:33,633 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:33,633 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230328 for table='ns:testMinorCompaction' and column='family1' 2023-03-28 05:55:33,633 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:33,634 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023032891b62afa9b8d41f9a291f6d9911b599e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023032891b62afa9b8d41f9a291f6d9911b599e 2023-03-28 05:55:33,634 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-28 05:55:33,634 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230328' 2023-03-28 05:55:33,635 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230328 for table='ns:testMinorCompaction' and column='family1' 2023-03-28 05:55:33,635 INFO [Listener at localhost/33463] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-28 05:55:33,637 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:33,639 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:33,642 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:33,644 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:33,666 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 275), OpenFileDescriptor=637 (was 707), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=353 (was 360), ProcessCount=170 (was 170), AvailableMemoryMB=4116 (was 4134) 2023-03-28 05:55:33,678 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=170, AvailableMemoryMB=4115 2023-03-28 05:55:33,680 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-28 05:55:33,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:33,682 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:55:33,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-28 05:55:33,682 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:55:33,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-28 05:55:33,683 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:33,684 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b empty. 2023-03-28 05:55:33,684 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:33,684 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-28 05:55:33,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-28 05:55:33,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-28 05:55:34,091 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-28 05:55:34,092 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 16cde93b0d2500a4100e8c4500f25b5b, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:55:34,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-28 05:55:34,498 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:34,498 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 16cde93b0d2500a4100e8c4500f25b5b, disabling compactions & flushes 2023-03-28 05:55:34,498 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:34,498 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:34,498 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. after waiting 0 ms 2023-03-28 05:55:34,498 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:34,498 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:34,498 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:34,500 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:55:34,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679982934501"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982934501"}]},"ts":"1679982934501"} 2023-03-28 05:55:34,503 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-28 05:55:34,504 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:55:34,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982934504"}]},"ts":"1679982934504"} 2023-03-28 05:55:34,505 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-28 05:55:34,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=16cde93b0d2500a4100e8c4500f25b5b, ASSIGN}] 2023-03-28 05:55:34,511 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=16cde93b0d2500a4100e8c4500f25b5b, ASSIGN 2023-03-28 05:55:34,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=16cde93b0d2500a4100e8c4500f25b5b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:55:34,663 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=16cde93b0d2500a4100e8c4500f25b5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:34,663 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679982934663"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982934663"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982934663"}]},"ts":"1679982934663"} 2023-03-28 05:55:34,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 16cde93b0d2500a4100e8c4500f25b5b, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:34,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-28 05:55:34,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:34,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 16cde93b0d2500a4100e8c4500f25b5b, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b.', STARTKEY => '', ENDKEY => ''} 2023-03-28 05:55:34,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:34,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:34,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:34,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:34,820 INFO [StoreOpener-16cde93b0d2500a4100e8c4500f25b5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:34,822 DEBUG [StoreOpener-16cde93b0d2500a4100e8c4500f25b5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:34,822 DEBUG [StoreOpener-16cde93b0d2500a4100e8c4500f25b5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:34,822 INFO [StoreOpener-16cde93b0d2500a4100e8c4500f25b5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 16cde93b0d2500a4100e8c4500f25b5b columnFamilyName family1 2023-03-28 05:55:34,824 INFO [StoreOpener-16cde93b0d2500a4100e8c4500f25b5b-1] regionserver.HStore(310): Store=16cde93b0d2500a4100e8c4500f25b5b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:34,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:34,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:34,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:55:34,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:55:34,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 16cde93b0d2500a4100e8c4500f25b5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75273905, jitterRate=0.12166859209537506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-28 05:55:34,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:34,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b., pid=114, masterSystemTime=1679982934816 2023-03-28 05:55:34,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:34,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:34,832 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=16cde93b0d2500a4100e8c4500f25b5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:34,832 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679982934832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982934832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982934832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982934832"}]},"ts":"1679982934832"} 2023-03-28 05:55:34,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-28 05:55:34,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 16cde93b0d2500a4100e8c4500f25b5b, server=jenkins-hbase4.apache.org,39167,1679982818904 in 168 msec 2023-03-28 05:55:34,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-28 05:55:34,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=16cde93b0d2500a4100e8c4500f25b5b, ASSIGN in 324 msec 2023-03-28 05:55:34,836 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:55:34,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982934836"}]},"ts":"1679982934836"} 2023-03-28 05:55:34,837 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-28 05:55:34,840 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:55:34,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1600 sec 2023-03-28 05:55:35,528 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:35,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-28 05:55:35,788 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-28 05:55:35,810 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:35,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,814 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:35,814 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:35,814 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:35,814 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:35,814 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,814 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,816 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:35,816 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:35,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:35,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:35,818 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:35,818 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,818 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:35,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:35,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:35,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:35,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:35,820 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:35,820 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:35,820 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:35,821 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-28 05:55:36,247 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304b3d4d60f032480a9bf4c92880f839c0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511304b3d4d60f032480a9bf4c92880f839c0 2023-03-28 05:55:36,250 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/ce954f05246645fdae04a28eae091aa0 2023-03-28 05:55:36,254 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/ce954f05246645fdae04a28eae091aa0 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/ce954f05246645fdae04a28eae091aa0 2023-03-28 05:55:36,257 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/ce954f05246645fdae04a28eae091aa0, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-28 05:55:36,258 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 437ms, sequenceid=5, compaction requested=false 2023-03-28 05:55:36,259 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:36,259 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:36,259 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:36,261 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,261 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,262 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,262 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:36,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3503140e[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:36,264 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:36,264 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,265 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,266 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:36,266 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:36,266 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:36,266 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,266 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:36,267 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:36,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:36,270 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:36,270 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:36,270 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:36,270 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,270 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:36,273 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,273 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:36,273 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:36,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:36,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,274 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,276 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,279 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:36,279 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,279 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:36,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:36,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:36,279 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:36,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:55:36,279 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:36,279 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:36,279 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:36,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:36,280 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:36,280 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:36,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,380 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:36,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:36,384 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:36,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:36,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,386 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:36,386 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:36,386 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:36,386 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:36,387 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,387 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,388 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,388 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:36,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:36,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:36,389 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,389 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:36,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:36,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,390 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:36,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,390 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:36,390 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:36,390 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:36,390 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:36,390 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:36,390 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:36,390 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:36,390 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-28 05:55:36,411 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288b95bfa211a94fbfb4fb29b1c100f1f9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288b95bfa211a94fbfb4fb29b1c100f1f9 2023-03-28 05:55:36,416 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/17d144a2ae3b43fdacc001e69dbe856d 2023-03-28 05:55:36,420 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/17d144a2ae3b43fdacc001e69dbe856d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/17d144a2ae3b43fdacc001e69dbe856d 2023-03-28 05:55:36,424 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/17d144a2ae3b43fdacc001e69dbe856d, entries=1, sequenceid=9, filesize=5.0 K 2023-03-28 05:55:36,424 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 34ms, sequenceid=9, compaction requested=false 2023-03-28 05:55:36,425 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:36,425 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:36,425 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:36,425 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:36,425 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,425 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:36,425 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:36,426 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,426 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,427 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,427 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:36,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a90c975[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:36,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:36,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,430 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,430 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:36,430 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:36,430 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:36,430 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,430 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:36,432 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,433 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,433 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:36,433 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:36,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:36,435 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:36,435 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:36,435 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:36,435 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,435 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:36,437 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,437 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,437 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:36,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,438 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,441 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:36,441 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,441 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:36,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:36,441 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:36,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:36,541 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:36,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:36,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:36,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:36,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,548 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:36,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:36,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:36,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:36,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,548 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,553 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:36,553 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:36,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:36,554 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,554 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:36,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:36,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,555 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,555 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:36,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:36,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:36,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:36,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:36,556 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:36,556 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:36,556 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:36,556 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:36,971 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012e317311ba9844108a29429097c98e3c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012e317311ba9844108a29429097c98e3c 2023-03-28 05:55:36,975 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/068840f5dee94550a38a2c4e9f283ba8 2023-03-28 05:55:36,980 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/068840f5dee94550a38a2c4e9f283ba8 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/068840f5dee94550a38a2c4e9f283ba8 2023-03-28 05:55:36,983 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/068840f5dee94550a38a2c4e9f283ba8, entries=1, sequenceid=13, filesize=4.9 K 2023-03-28 05:55:36,984 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 428ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:36,984 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:36,984 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:36,986 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,986 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:36,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@671e174d[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:36,987 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:36,987 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,988 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,989 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:36,989 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:36,989 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:36,989 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,989 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:36,990 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,990 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:36,990 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,990 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:36,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:36,993 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:36,993 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:36,993 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:36,993 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,993 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:36,995 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,995 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:36,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,995 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:36,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:36,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:37,000 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,004 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:37,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,007 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:37,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:37,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,008 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:37,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:37,008 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:37,008 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:37,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:37,009 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:37,009 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:37,109 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:37,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:37,114 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:37,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:37,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,116 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:37,116 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:37,116 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:37,116 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:37,116 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,116 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,118 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,118 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:37,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:37,118 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,118 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,119 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,119 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:37,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,119 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:37,119 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:37,120 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:37,120 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:37,120 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:37,120 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:37,120 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:37,120 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:37,534 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f4f8ab147cb74ecbb33d5ee1dfc3eb75 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205f4f8ab147cb74ecbb33d5ee1dfc3eb75 2023-03-28 05:55:37,540 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/1637f18721e64962b718a73ce05e551e 2023-03-28 05:55:37,548 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/1637f18721e64962b718a73ce05e551e as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1637f18721e64962b718a73ce05e551e 2023-03-28 05:55:37,553 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1637f18721e64962b718a73ce05e551e, entries=1, sequenceid=17, filesize=4.9 K 2023-03-28 05:55:37,554 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 434ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:37,554 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:37,554 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:37,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:37,556 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,556 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:37,557 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,557 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:37,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:37,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:37,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7acb9196[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:37,559 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:37,559 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,561 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,562 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:37,562 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:37,562 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:37,562 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,562 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:37,563 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:37,563 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:37,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:37,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:37,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:37,567 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:37,567 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:37,567 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:37,568 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,568 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:37,569 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,569 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:37,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:37,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,570 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:37,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:37,573 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:37,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:37,579 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:37,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,582 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:37,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:37,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:37,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:55:37,583 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:37,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:37,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:37,583 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:37,584 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:37,684 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:37,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:37,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:37,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:37,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,689 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:37,689 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:37,689 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:37,689 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:37,690 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,690 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,692 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:37,692 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:37,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:37,693 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:37,693 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:37,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:37,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,693 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:37,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:37,693 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:37,693 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:37,694 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:37,694 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:37,694 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:37,694 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:37,694 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:37,694 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:38,104 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e3712c976bff4cb5ac673762d5670e7a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228e3712c976bff4cb5ac673762d5670e7a 2023-03-28 05:55:38,509 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/51ea7b8565c84e2597d4a7e216bc5c27 2023-03-28 05:55:38,512 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/51ea7b8565c84e2597d4a7e216bc5c27 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/51ea7b8565c84e2597d4a7e216bc5c27 2023-03-28 05:55:38,515 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/51ea7b8565c84e2597d4a7e216bc5c27, entries=1, sequenceid=21, filesize=4.9 K 2023-03-28 05:55:38,516 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 822ms, sequenceid=21, compaction requested=true 2023-03-28 05:55:38,516 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:38,516 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:38,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:38,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:38,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:38,516 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:38,518 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,518 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:38,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:38,518 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,519 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:38,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:38,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dd139ec[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:38,520 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:38,520 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,521 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:38,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:38,521 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:38,521 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,521 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:38,523 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:38,523 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:38,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:38,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:38,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:38,525 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:38,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:38,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:38,525 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,525 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:38,528 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,528 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:38,528 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:38,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:38,528 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:38,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,529 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:38,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:38,534 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:38,534 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,534 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:38,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:38,534 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,634 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:38,639 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:38,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:38,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,640 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:38,640 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:38,640 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:38,640 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:38,641 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,641 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,642 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,642 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:38,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:38,642 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:38,642 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,643 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,643 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:38,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:38,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:38,643 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:38,643 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:39,053 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c1e3f8a1d44f4bec973a28e0752a4ee9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1e3f8a1d44f4bec973a28e0752a4ee9 2023-03-28 05:55:39,457 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/4389e3e3be88484e91ed6ce1d300311d 2023-03-28 05:55:39,461 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/4389e3e3be88484e91ed6ce1d300311d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/4389e3e3be88484e91ed6ce1d300311d 2023-03-28 05:55:39,463 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/4389e3e3be88484e91ed6ce1d300311d, entries=1, sequenceid=25, filesize=4.9 K 2023-03-28 05:55:39,464 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 821ms, sequenceid=25, compaction requested=true 2023-03-28 05:55:39,464 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:39,464 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:39,464 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:39,464 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:39,464 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,465 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:39,465 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:39,466 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,466 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:39,466 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,466 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:39,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:39,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31469c42[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:39,468 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:39,468 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,469 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,469 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:39,469 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:39,469 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:39,469 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,469 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:39,471 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:39,471 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,471 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,471 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:39,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:39,473 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:39,473 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:39,473 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:39,473 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,473 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:39,475 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,475 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:39,475 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:39,475 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,476 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,478 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,478 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:39,478 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:39,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:39,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:55:39,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:39,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:39,478 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:39,478 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,479 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,479 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,479 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,479 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,478 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:39,479 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:39,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:39,479 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:39,579 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:39,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:39,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:39,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:39,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,585 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:39,585 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:39,585 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:39,585 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:39,586 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,586 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,587 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:39,587 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:39,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:39,587 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:39,587 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:39,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:39,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,588 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,588 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:39,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:39,588 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:39,588 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:39,588 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:39,589 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:39,589 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:39,589 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:39,589 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:39,999 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010146755028440f4756aadb9429a91d6893 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010146755028440f4756aadb9429a91d6893 2023-03-28 05:55:40,361 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:55:40,404 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/7d1c0a90d0fe439da2752f9b1ac2b85e 2023-03-28 05:55:40,408 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/7d1c0a90d0fe439da2752f9b1ac2b85e as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/7d1c0a90d0fe439da2752f9b1ac2b85e 2023-03-28 05:55:40,411 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/7d1c0a90d0fe439da2752f9b1ac2b85e, entries=1, sequenceid=29, filesize=4.9 K 2023-03-28 05:55:40,412 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 823ms, sequenceid=29, compaction requested=true 2023-03-28 05:55:40,412 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:40,412 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:40,412 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:40,415 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,415 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:40,415 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,415 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:40,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:40,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26f55158[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:40,416 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:40,416 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,417 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:40,418 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:40,418 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,418 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:40,419 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:40,419 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:40,419 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,419 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:40,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:40,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:40,421 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:40,421 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:40,421 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:40,421 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,421 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:40,423 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,423 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:40,423 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:40,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:40,423 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,425 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:40,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,428 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:40,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:40,428 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:40,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:40,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:40,428 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,429 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:40,429 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:40,429 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:40,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:40,429 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,429 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,529 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:40,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:40,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:40,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:40,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,535 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:40,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:40,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:40,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:40,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,535 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,536 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,536 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:40,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:40,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:40,537 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,538 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,538 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:40,538 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:40,538 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:40,538 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:40,949 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038c72d1e8786b4307b6e8320ece9bb770 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038c72d1e8786b4307b6e8320ece9bb770 2023-03-28 05:55:41,353 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/48f180f1266a40969d5ea406ef0c9823 2023-03-28 05:55:41,357 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/48f180f1266a40969d5ea406ef0c9823 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/48f180f1266a40969d5ea406ef0c9823 2023-03-28 05:55:41,362 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/48f180f1266a40969d5ea406ef0c9823, entries=1, sequenceid=33, filesize=4.9 K 2023-03-28 05:55:41,363 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 825ms, sequenceid=33, compaction requested=true 2023-03-28 05:55:41,363 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:41,363 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:41,363 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:41,363 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:41,363 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,363 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:41,363 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,365 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,365 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:41,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:41,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@942331[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:41,366 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:41,366 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,368 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,368 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:41,368 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,368 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:41,368 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:41,369 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:41,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:41,370 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:41,370 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:41,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:41,372 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:41,372 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:41,372 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:41,372 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,372 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:41,373 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,373 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:41,373 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:41,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:41,374 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:41,375 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:41,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:41,380 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:41,380 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:41,380 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:41,380 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:41,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:55:41,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,381 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:41,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:41,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,381 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:41,381 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,481 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:41,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:41,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:41,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:41,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,487 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:41,487 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:41,487 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:41,487 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:41,487 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,487 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,489 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,489 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:41,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:41,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:41,489 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:41,490 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,490 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,490 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:41,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:41,491 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:41,491 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:41,491 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:41,901 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090770143a305f764c12a7451c1fa793f07a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090770143a305f764c12a7451c1fa793f07a 2023-03-28 05:55:42,306 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/1e3df70abf0d42af9aae7d15349473a6 2023-03-28 05:55:42,311 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/1e3df70abf0d42af9aae7d15349473a6 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1e3df70abf0d42af9aae7d15349473a6 2023-03-28 05:55:42,314 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1e3df70abf0d42af9aae7d15349473a6, entries=1, sequenceid=37, filesize=4.9 K 2023-03-28 05:55:42,315 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 824ms, sequenceid=37, compaction requested=true 2023-03-28 05:55:42,315 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:42,315 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:42,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:42,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:42,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:42,315 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:42,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,317 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:42,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,317 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:42,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:42,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74fe7496[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:42,319 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:42,319 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,320 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:42,320 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,320 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:42,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:42,320 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:42,322 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,323 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:42,323 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:42,323 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:42,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:42,325 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:42,325 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:42,325 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:42,325 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,325 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:42,326 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,326 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:42,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,326 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:42,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:42,327 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:42,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,328 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:42,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:42,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,330 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:42,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,330 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:42,330 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:42,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:42,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:42,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:42,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:55:42,330 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,331 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:42,331 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:42,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:42,331 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:42,331 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,331 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,431 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:42,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:42,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:42,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:42,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,436 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:42,436 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:42,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-28 05:55:42,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-28 05:55:42,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,437 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,438 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,438 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:42,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:42,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:42,439 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:42,439 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:42,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,440 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-28 05:55:42,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-28 05:55:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-28 05:55:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-28 05:55:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:42,440 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:42,440 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. started... 2023-03-28 05:55:42,440 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 16cde93b0d2500a4100e8c4500f25b5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-28 05:55:42,851 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112048e248509cdb49509c642d97e2112e68 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112048e248509cdb49509c642d97e2112e68 2023-03-28 05:55:43,256 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/66a1d05183b64687be1a912255db1fb2 2023-03-28 05:55:43,260 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/66a1d05183b64687be1a912255db1fb2 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/66a1d05183b64687be1a912255db1fb2 2023-03-28 05:55:43,262 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/66a1d05183b64687be1a912255db1fb2, entries=1, sequenceid=41, filesize=4.9 K 2023-03-28 05:55:43,263 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 16cde93b0d2500a4100e8c4500f25b5b in 823ms, sequenceid=41, compaction requested=true 2023-03-28 05:55:43,263 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:43,263 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-28 05:55:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-28 05:55:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-28 05:55:43,264 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-28 05:55:43,266 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,266 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:43,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:43,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-28 05:55:43,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71df42c7[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:43,268 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-28 05:55:43,268 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,270 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,270 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-28 05:55:43,270 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-28 05:55:43,270 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:43,270 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,270 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:43,271 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,271 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-28 05:55:43,271 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:43,271 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-28 05:55:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:43,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-28 05:55:43,273 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-28 05:55:43,273 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:43,273 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:43,273 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,273 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:43,275 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,275 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:43,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,275 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:43,276 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,277 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:43,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,280 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:43,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-28 05:55:43,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:43,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:43,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:43,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:43,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-28 05:55:43,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:43,280 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,281 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,281 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:43,281 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:43,281 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:43,381 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:43,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:43,383 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-28 05:55:43,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:55:43,385 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:55:43,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:55:43,386 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983543386 2023-03-28 05:55:43,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-28 05:55:43,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-28 05:55:43,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:43,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x21bf8e25 to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:55:43,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ffc0ed0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:55:43,392 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:44,218 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010310befa2ab4104b03951c727fb1d8b991 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010310befa2ab4104b03951c727fb1d8b991 2023-03-28 05:55:44,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:44,232 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:55:44,234 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:55:44,242 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:55:44,243 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59724, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:55:44,250 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ca7b1074880f4a4e886531096aaf5de4 first=Optional[r5] last=Optional[r6] 2023-03-28 05:55:44,250 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ca7b1074880f4a4e886531096aaf5de4}] 2023-03-28 05:55:44,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ca7b1074880f4a4e886531096aaf5de4 for inclusion in 16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:44,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-28 05:55:44,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:55:44,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:44,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ca7b1074880f4a4e886531096aaf5de4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__li4jsqhh9q39lf0d99dnn566uhfhk00qfi6d1pgp2af1asokm4utchm3rtsk4cbp/family1/ca7b1074880f4a4e886531096aaf5de4 2023-03-28 05:55:44,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__li4jsqhh9q39lf0d99dnn566uhfhk00qfi6d1pgp2af1asokm4utchm3rtsk4cbp/family1/ca7b1074880f4a4e886531096aaf5de4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_ 2023-03-28 05:55:44,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__li4jsqhh9q39lf0d99dnn566uhfhk00qfi6d1pgp2af1asokm4utchm3rtsk4cbp/family1/ca7b1074880f4a4e886531096aaf5de4 into 16cde93b0d2500a4100e8c4500f25b5b/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_ - updating store file list. 2023-03-28 05:55:44,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_ into 16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:44,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__li4jsqhh9q39lf0d99dnn566uhfhk00qfi6d1pgp2af1asokm4utchm3rtsk4cbp/family1/ca7b1074880f4a4e886531096aaf5de4 into 16cde93b0d2500a4100e8c4500f25b5b/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_) 2023-03-28 05:55:44,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__li4jsqhh9q39lf0d99dnn566uhfhk00qfi6d1pgp2af1asokm4utchm3rtsk4cbp/family1/ca7b1074880f4a4e886531096aaf5de4 2023-03-28 05:55:44,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-28 05:55:44,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-28 05:55:44,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(1912): 16cde93b0d2500a4100e8c4500f25b5b/family1 is initiating minor compaction 2023-03-28 05:55:44,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@16ee51e5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:55:44,266 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 16cde93b0d2500a4100e8c4500f25b5b/family1 in testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:44,266 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/17d144a2ae3b43fdacc001e69dbe856d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/068840f5dee94550a38a2c4e9f283ba8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1637f18721e64962b718a73ce05e551e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/51ea7b8565c84e2597d4a7e216bc5c27, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/4389e3e3be88484e91ed6ce1d300311d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/7d1c0a90d0fe439da2752f9b1ac2b85e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/48f180f1266a40969d5ea406ef0c9823, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1e3df70abf0d42af9aae7d15349473a6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/66a1d05183b64687be1a912255db1fb2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp, totalSize=49.7 K 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 17d144a2ae3b43fdacc001e69dbe856d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 068840f5dee94550a38a2c4e9f283ba8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 1637f18721e64962b718a73ce05e551e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 51ea7b8565c84e2597d4a7e216bc5c27, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 4389e3e3be88484e91ed6ce1d300311d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 7d1c0a90d0fe439da2752f9b1ac2b85e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 48f180f1266a40969d5ea406ef0c9823, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 1e3df70abf0d42af9aae7d15349473a6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 66a1d05183b64687be1a912255db1fb2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-28 05:55:44,266 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 67625b71438149e09988e8b923355897_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-28 05:55:44,272 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:44,273 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:44,274 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010146755028440f4756aadb9429a91d6893 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010146755028440f4756aadb9429a91d6893 2023-03-28 05:55:44,275 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038c72d1e8786b4307b6e8320ece9bb770 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038c72d1e8786b4307b6e8320ece9bb770 2023-03-28 05:55:44,275 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-28 05:55:44,275 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-28 05:55:44,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:44,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:44,296 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 16cde93b0d2500a4100e8c4500f25b5b#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-03-28 05:55:44,733 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313ebf266e0086454e9082e6ec286bd33f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512313ebf266e0086454e9082e6ec286bd33f 2023-03-28 05:55:44,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:44,764 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32d332609f43440dbeae614faa14254c first=Optional[r1] last=Optional[r4] 2023-03-28 05:55:44,765 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32d332609f43440dbeae614faa14254c}] 2023-03-28 05:55:44,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32d332609f43440dbeae614faa14254c for inclusion in 16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-28 05:55:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:55:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:44,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32d332609f43440dbeae614faa14254c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q9a8u84flk4ehnhbfsmlmo3n6edtbbqvh0kq4523o1mnhsb4f8qgtbgv9bolm1v9/family1/32d332609f43440dbeae614faa14254c 2023-03-28 05:55:44,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q9a8u84flk4ehnhbfsmlmo3n6edtbbqvh0kq4523o1mnhsb4f8qgtbgv9bolm1v9/family1/32d332609f43440dbeae614faa14254c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_ 2023-03-28 05:55:44,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q9a8u84flk4ehnhbfsmlmo3n6edtbbqvh0kq4523o1mnhsb4f8qgtbgv9bolm1v9/family1/32d332609f43440dbeae614faa14254c into 16cde93b0d2500a4100e8c4500f25b5b/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_ - updating store file list. 2023-03-28 05:55:44,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_ into 16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:44,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q9a8u84flk4ehnhbfsmlmo3n6edtbbqvh0kq4523o1mnhsb4f8qgtbgv9bolm1v9/family1/32d332609f43440dbeae614faa14254c into 16cde93b0d2500a4100e8c4500f25b5b/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_) 2023-03-28 05:55:44,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q9a8u84flk4ehnhbfsmlmo3n6edtbbqvh0kq4523o1mnhsb4f8qgtbgv9bolm1v9/family1/32d332609f43440dbeae614faa14254c 2023-03-28 05:55:44,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:44,778 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:44,779 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012e317311ba9844108a29429097c98e3c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512012e317311ba9844108a29429097c98e3c 2023-03-28 05:55:44,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205f4f8ab147cb74ecbb33d5ee1dfc3eb75 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205f4f8ab147cb74ecbb33d5ee1dfc3eb75 2023-03-28 05:55:44,781 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228e3712c976bff4cb5ac673762d5670e7a to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228e3712c976bff4cb5ac673762d5670e7a 2023-03-28 05:55:44,782 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1e3f8a1d44f4bec973a28e0752a4ee9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1e3f8a1d44f4bec973a28e0752a4ee9 2023-03-28 05:55:44,782 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-28 05:55:44,782 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-28 05:55:44,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:44,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:44,801 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:55:44,801 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x293644a6 to 127.0.0.1:58236 2023-03-28 05:55:44,801 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:44,801 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:55:44,801 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27841654 to 127.0.0.1:58236 2023-03-28 05:55:44,801 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:55:45,108 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/1bec6fbc2b5a43b1bb4bf3bbd4615a41 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1bec6fbc2b5a43b1bb4bf3bbd4615a41 2023-03-28 05:55:45,112 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 16cde93b0d2500a4100e8c4500f25b5b/family1 of 16cde93b0d2500a4100e8c4500f25b5b into 1bec6fbc2b5a43b1bb4bf3bbd4615a41(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:45,112 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:45,113 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679982944265; duration=0sec 2023-03-28 05:55:45,113 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:55:45,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/17d144a2ae3b43fdacc001e69dbe856d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/068840f5dee94550a38a2c4e9f283ba8, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1637f18721e64962b718a73ce05e551e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/51ea7b8565c84e2597d4a7e216bc5c27, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/4389e3e3be88484e91ed6ce1d300311d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/7d1c0a90d0fe439da2752f9b1ac2b85e, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/48f180f1266a40969d5ea406ef0c9823, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1e3df70abf0d42af9aae7d15349473a6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/66a1d05183b64687be1a912255db1fb2, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_] to archive 2023-03-28 05:55:45,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:45,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/17d144a2ae3b43fdacc001e69dbe856d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/17d144a2ae3b43fdacc001e69dbe856d 2023-03-28 05:55:45,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/068840f5dee94550a38a2c4e9f283ba8 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/068840f5dee94550a38a2c4e9f283ba8 2023-03-28 05:55:45,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1637f18721e64962b718a73ce05e551e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1637f18721e64962b718a73ce05e551e 2023-03-28 05:55:45,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/51ea7b8565c84e2597d4a7e216bc5c27 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/51ea7b8565c84e2597d4a7e216bc5c27 2023-03-28 05:55:45,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/4389e3e3be88484e91ed6ce1d300311d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/4389e3e3be88484e91ed6ce1d300311d 2023-03-28 05:55:45,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/7d1c0a90d0fe439da2752f9b1ac2b85e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/7d1c0a90d0fe439da2752f9b1ac2b85e 2023-03-28 05:55:45,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/48f180f1266a40969d5ea406ef0c9823 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/48f180f1266a40969d5ea406ef0c9823 2023-03-28 05:55:45,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1e3df70abf0d42af9aae7d15349473a6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1e3df70abf0d42af9aae7d15349473a6 2023-03-28 05:55:45,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/66a1d05183b64687be1a912255db1fb2 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/66a1d05183b64687be1a912255db1fb2 2023-03-28 05:55:45,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/67625b71438149e09988e8b923355897_SeqId_44_ 2023-03-28 05:55:45,630 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130209dfc247d9347d691821989596d0ae3 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130209dfc247d9347d691821989596d0ae3 2023-03-28 05:55:45,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:45,658 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2e5892d480a946118da389b12c41b0ba first=Optional[r00] last=Optional[r8] 2023-03-28 05:55:45,659 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2e5892d480a946118da389b12c41b0ba}] 2023-03-28 05:55:45,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2e5892d480a946118da389b12c41b0ba for inclusion in 16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:45,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-28 05:55:45,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last= 2023-03-28 05:55:45,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:45,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2e5892d480a946118da389b12c41b0ba to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6uqb19u2vljhjvn9aa3as996p8rd1v8lc1o382087umd0orkqraasf6m025a84j1/family1/2e5892d480a946118da389b12c41b0ba 2023-03-28 05:55:45,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6uqb19u2vljhjvn9aa3as996p8rd1v8lc1o382087umd0orkqraasf6m025a84j1/family1/2e5892d480a946118da389b12c41b0ba as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_ 2023-03-28 05:55:45,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6uqb19u2vljhjvn9aa3as996p8rd1v8lc1o382087umd0orkqraasf6m025a84j1/family1/2e5892d480a946118da389b12c41b0ba into 16cde93b0d2500a4100e8c4500f25b5b/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_ - updating store file list. 2023-03-28 05:55:45,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_ into 16cde93b0d2500a4100e8c4500f25b5b/family1 2023-03-28 05:55:45,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6uqb19u2vljhjvn9aa3as996p8rd1v8lc1o382087umd0orkqraasf6m025a84j1/family1/2e5892d480a946118da389b12c41b0ba into 16cde93b0d2500a4100e8c4500f25b5b/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_) 2023-03-28 05:55:45,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6uqb19u2vljhjvn9aa3as996p8rd1v8lc1o382087umd0orkqraasf6m025a84j1/family1/2e5892d480a946118da389b12c41b0ba 2023-03-28 05:55:45,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-28 05:55:45,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-28 05:55:45,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(1912): 16cde93b0d2500a4100e8c4500f25b5b/family1 is initiating minor compaction (all files) 2023-03-28 05:55:45,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8054cda; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:55:45,676 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 16cde93b0d2500a4100e8c4500f25b5b/family1 in testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:55:45,676 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/ce954f05246645fdae04a28eae091aa0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1bec6fbc2b5a43b1bb4bf3bbd4615a41, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp, totalSize=344.3 K 2023-03-28 05:55:45,677 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting ce954f05246645fdae04a28eae091aa0, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843296 2023-03-28 05:55:45,677 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 1bec6fbc2b5a43b1bb4bf3bbd4615a41, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243296 2023-03-28 05:55:45,677 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965243296 2023-03-28 05:55:45,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:45,678 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] compactions.Compactor(207): Compacting 3717a06b2fa745dba37058417a4898e5_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014843296 2023-03-28 05:55:45,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:45,680 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112048e248509cdb49509c642d97e2112e68 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112048e248509cdb49509c642d97e2112e68 2023-03-28 05:55:45,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288b95bfa211a94fbfb4fb29b1c100f1f9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288b95bfa211a94fbfb4fb29b1c100f1f9 2023-03-28 05:55:45,691 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511304b3d4d60f032480a9bf4c92880f839c0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511304b3d4d60f032480a9bf4c92880f839c0 2023-03-28 05:55:45,692 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-28 05:55:45,692 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-28 05:55:45,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:45,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:45,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-28 05:55:45,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-28 05:55:45,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:55:45,696 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-28 05:55:45,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3130 sec 2023-03-28 05:55:45,712 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] throttle.PressureAwareThroughputController(145): 16cde93b0d2500a4100e8c4500f25b5b#family1#compaction#167 average throughput is 9.73 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-03-28 05:55:46,019 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255 (was 250) - Thread LEAK? -, OpenFileDescriptor=634 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 353), ProcessCount=170 (was 170), AvailableMemoryMB=4068 (was 4115) 2023-03-28 05:55:46,031 INFO [Listener at localhost/33463] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=255, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=4067 2023-03-28 05:55:46,059 DEBUG [Listener at localhost/33463] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-28 05:55:46,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2\xEC\xB8\xC6&\xC0\xA6'E\x12J\xC6\xB5t\x89\x02"\x10\x8E#\xFEK XU\xCE\xFC\x80\xFB\x91\xAC\x9DG3*\x10\xDF\xFE:p7fn\xDC\x18=Qs\x97\xF3$\xE92\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-28 05:55:46,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-28 05:55:46,139 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-28 05:55:46,139 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-28 05:55:46,139 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-28 05:55:46,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-28 05:55:46,142 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:46,142 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:46,142 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:46,142 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39 empty. 2023-03-28 05:55:46,142 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772 empty. 2023-03-28 05:55:46,143 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770 empty. 2023-03-28 05:55:46,143 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:46,143 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:46,144 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:46,144 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-28 05:55:46,170 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/.tmp/family1/9119083304e945a2bfdb37e38d00dd01 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/9119083304e945a2bfdb37e38d00dd01 2023-03-28 05:55:46,174 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 16cde93b0d2500a4100e8c4500f25b5b/family1 of 16cde93b0d2500a4100e8c4500f25b5b into 9119083304e945a2bfdb37e38d00dd01(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:46,174 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:55:46,174 INFO [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1679982945676; duration=0sec 2023-03-28 05:55:46,175 DEBUG [RS:0;jenkins-hbase4:39167-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-28 05:55:46,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/ce954f05246645fdae04a28eae091aa0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1bec6fbc2b5a43b1bb4bf3bbd4615a41, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_] to archive 2023-03-28 05:55:46,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:46,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/ce954f05246645fdae04a28eae091aa0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/ce954f05246645fdae04a28eae091aa0 2023-03-28 05:55:46,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1bec6fbc2b5a43b1bb4bf3bbd4615a41 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/1bec6fbc2b5a43b1bb4bf3bbd4615a41 2023-03-28 05:55:46,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/a3e8bf5bee8a4be587855a760a75cd36_SeqId_46_ 2023-03-28 05:55:46,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_ to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/family1/3717a06b2fa745dba37058417a4898e5_SeqId_49_ 2023-03-28 05:55:46,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-28 05:55:46,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-28 05:55:46,553 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-28 05:55:46,555 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 76bcd31990dc0cfde08671d440cb2770, NAME => 'testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2\xEC\xB8\xC6&\xC0\xA6'E\x12J\xC6\xB5t\x89\x02"\x10\x8E#\xFEK XU\xCE\xFC\x80\xFB\x91\xAC\x9DG3*\x10\xDF\xFE:p7fn\xDC\x18=Qs\x97\xF3$\xE92\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:55:46,555 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => e5c16240836799dbf440abc94166ed39, NAME => 'testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2\xEC\xB8\xC6&\xC0\xA6'E\x12J\xC6\xB5t\x89\x02"\x10\x8E#\xFEK XU\xCE\xFC\x80\xFB\x91\xAC\x9DG3*\x10\xDF\xFE:p7fn\xDC\x18=Qs\x97\xF3$\xE92\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:55:46,555 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 005d70613c3a21956f06dc3c182dc772, NAME => 'testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2\xEC\xB8\xC6&\xC0\xA6'E\x12J\xC6\xB5t\x89\x02"\x10\x8E#\xFEK XU\xCE\xFC\x80\xFB\x91\xAC\x9DG3*\x10\xDF\xFE:p7fn\xDC\x18=Qs\x97\xF3$\xE92\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/.tmp 2023-03-28 05:55:46,584 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:46,584 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing e5c16240836799dbf440abc94166ed39, disabling compactions & flushes 2023-03-28 05:55:46,584 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:46,584 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:46,585 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. after waiting 0 ms 2023-03-28 05:55:46,585 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:46,585 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:46,585 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:46,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-28 05:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 76bcd31990dc0cfde08671d440cb2770, disabling compactions & flushes 2023-03-28 05:55:46,963 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. after waiting 0 ms 2023-03-28 05:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:46,963 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:46,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:46,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 005d70613c3a21956f06dc3c182dc772, disabling compactions & flushes 2023-03-28 05:55:46,974 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:46,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:46,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. after waiting 0 ms 2023-03-28 05:55:46,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:46,974 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:46,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:46,976 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-28 05:55:46,977 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982946977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982946977"}]},"ts":"1679982946977"} 2023-03-28 05:55:46,977 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982946977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982946977"}]},"ts":"1679982946977"} 2023-03-28 05:55:46,977 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679982946977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679982946977"}]},"ts":"1679982946977"} 2023-03-28 05:55:46,979 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-28 05:55:46,980 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-28 05:55:46,980 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982946980"}]},"ts":"1679982946980"} 2023-03-28 05:55:46,981 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-28 05:55:46,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e5c16240836799dbf440abc94166ed39, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=005d70613c3a21956f06dc3c182dc772, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=76bcd31990dc0cfde08671d440cb2770, ASSIGN}] 2023-03-28 05:55:46,986 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=76bcd31990dc0cfde08671d440cb2770, ASSIGN 2023-03-28 05:55:46,986 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=005d70613c3a21956f06dc3c182dc772, ASSIGN 2023-03-28 05:55:46,988 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=76bcd31990dc0cfde08671d440cb2770, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:55:46,988 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=005d70613c3a21956f06dc3c182dc772, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:55:46,989 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e5c16240836799dbf440abc94166ed39, ASSIGN 2023-03-28 05:55:46,989 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e5c16240836799dbf440abc94166ed39, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39167,1679982818904; forceNewPlan=false, retain=false 2023-03-28 05:55:47,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=005d70613c3a21956f06dc3c182dc772, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:47,140 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e5c16240836799dbf440abc94166ed39, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:47,140 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=76bcd31990dc0cfde08671d440cb2770, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:47,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679982947140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982947140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982947140"}]},"ts":"1679982947140"} 2023-03-28 05:55:47,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982947140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982947140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982947140"}]},"ts":"1679982947140"} 2023-03-28 05:55:47,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982947140"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1679982947140"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679982947140"}]},"ts":"1679982947140"} 2023-03-28 05:55:47,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 005d70613c3a21956f06dc3c182dc772, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:47,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 76bcd31990dc0cfde08671d440cb2770, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:47,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure e5c16240836799dbf440abc94166ed39, server=jenkins-hbase4.apache.org,39167,1679982818904}] 2023-03-28 05:55:47,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-28 05:55:47,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:47,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 005d70613c3a21956f06dc3c182dc772, NAME => 'testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772.', STARTKEY => '1', ENDKEY => '2'} 2023-03-28 05:55:47,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:47,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,326 INFO [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,329 DEBUG [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1 2023-03-28 05:55:47,329 DEBUG [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1 2023-03-28 05:55:47,329 INFO [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 005d70613c3a21956f06dc3c182dc772 columnFamilyName family1 2023-03-28 05:55:47,331 INFO [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] regionserver.HStore(310): Store=005d70613c3a21956f06dc3c182dc772/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:47,331 INFO [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,332 DEBUG [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2 2023-03-28 05:55:47,332 DEBUG [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2 2023-03-28 05:55:47,333 INFO [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 005d70613c3a21956f06dc3c182dc772 columnFamilyName family2 2023-03-28 05:55:47,334 INFO [StoreOpener-005d70613c3a21956f06dc3c182dc772-1] regionserver.HStore(310): Store=005d70613c3a21956f06dc3c182dc772/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:47,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:47,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 005d70613c3a21956f06dc3c182dc772 2023-03-28 05:55:47,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:55:47,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 005d70613c3a21956f06dc3c182dc772; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66941851, jitterRate=-0.0024886876344680786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:47,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:47,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772., pid=120, masterSystemTime=1679982947293 2023-03-28 05:55:47,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:47,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:47,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:47,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76bcd31990dc0cfde08671d440cb2770, NAME => 'testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770.', STARTKEY => '2', ENDKEY => ''} 2023-03-28 05:55:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,343 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=005d70613c3a21956f06dc3c182dc772, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:47,343 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679982947343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982947343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982947343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982947343"}]},"ts":"1679982947343"} 2023-03-28 05:55:47,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-03-28 05:55:47,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 005d70613c3a21956f06dc3c182dc772, server=jenkins-hbase4.apache.org,39167,1679982818904 in 203 msec 2023-03-28 05:55:47,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=005d70613c3a21956f06dc3c182dc772, ASSIGN in 362 msec 2023-03-28 05:55:47,373 INFO [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,374 DEBUG [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1 2023-03-28 05:55:47,374 DEBUG [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1 2023-03-28 05:55:47,375 INFO [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76bcd31990dc0cfde08671d440cb2770 columnFamilyName family1 2023-03-28 05:55:47,376 INFO [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] regionserver.HStore(310): Store=76bcd31990dc0cfde08671d440cb2770/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:47,377 INFO [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,378 DEBUG [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2 2023-03-28 05:55:47,378 DEBUG [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2 2023-03-28 05:55:47,378 INFO [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76bcd31990dc0cfde08671d440cb2770 columnFamilyName family2 2023-03-28 05:55:47,379 INFO [StoreOpener-76bcd31990dc0cfde08671d440cb2770-1] regionserver.HStore(310): Store=76bcd31990dc0cfde08671d440cb2770/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:47,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:47,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:55:47,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:55:47,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76bcd31990dc0cfde08671d440cb2770; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63731308, jitterRate=-0.050329506397247314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:47,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:47,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770., pid=121, masterSystemTime=1679982947293 2023-03-28 05:55:47,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:47,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:47,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:47,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5c16240836799dbf440abc94166ed39, NAME => 'testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39.', STARTKEY => '', ENDKEY => '1'} 2023-03-28 05:55:47,388 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=76bcd31990dc0cfde08671d440cb2770, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:47,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-28 05:55:47,389 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982947388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982947388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982947388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982947388"}]},"ts":"1679982947388"} 2023-03-28 05:55:47,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-03-28 05:55:47,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 76bcd31990dc0cfde08671d440cb2770, server=jenkins-hbase4.apache.org,39167,1679982818904 in 248 msec 2023-03-28 05:55:47,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=76bcd31990dc0cfde08671d440cb2770, ASSIGN in 408 msec 2023-03-28 05:55:47,418 INFO [StoreOpener-e5c16240836799dbf440abc94166ed39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,419 DEBUG [StoreOpener-e5c16240836799dbf440abc94166ed39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1 2023-03-28 05:55:47,419 DEBUG [StoreOpener-e5c16240836799dbf440abc94166ed39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1 2023-03-28 05:55:47,420 INFO [StoreOpener-e5c16240836799dbf440abc94166ed39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5c16240836799dbf440abc94166ed39 columnFamilyName family1 2023-03-28 05:55:47,421 INFO [StoreOpener-e5c16240836799dbf440abc94166ed39-1] regionserver.HStore(310): Store=e5c16240836799dbf440abc94166ed39/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:47,421 INFO [StoreOpener-e5c16240836799dbf440abc94166ed39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,422 DEBUG [StoreOpener-e5c16240836799dbf440abc94166ed39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2 2023-03-28 05:55:47,422 DEBUG [StoreOpener-e5c16240836799dbf440abc94166ed39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2 2023-03-28 05:55:47,423 INFO [StoreOpener-e5c16240836799dbf440abc94166ed39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5c16240836799dbf440abc94166ed39 columnFamilyName family2 2023-03-28 05:55:47,424 INFO [StoreOpener-e5c16240836799dbf440abc94166ed39-1] regionserver.HStore(310): Store=e5c16240836799dbf440abc94166ed39/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-28 05:55:47,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-28 05:55:47,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e5c16240836799dbf440abc94166ed39 2023-03-28 05:55:47,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-28 05:55:47,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e5c16240836799dbf440abc94166ed39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66749111, jitterRate=-0.005360737442970276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-28 05:55:47,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:47,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39., pid=122, masterSystemTime=1679982947293 2023-03-28 05:55:47,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:47,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:47,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e5c16240836799dbf440abc94166ed39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:47,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679982947432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1679982947432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679982947432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679982947432"}]},"ts":"1679982947432"} 2023-03-28 05:55:47,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-03-28 05:55:47,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure e5c16240836799dbf440abc94166ed39, server=jenkins-hbase4.apache.org,39167,1679982818904 in 290 msec 2023-03-28 05:55:47,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-03-28 05:55:47,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e5c16240836799dbf440abc94166ed39, ASSIGN in 451 msec 2023-03-28 05:55:47,436 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-28 05:55:47,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679982947437"}]},"ts":"1679982947437"} 2023-03-28 05:55:47,438 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-28 05:55:47,440 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-28 05:55:47,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3040 sec 2023-03-28 05:55:47,531 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-28 05:55:48,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-28 05:55:48,246 INFO [Listener at localhost/33463] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-28 05:55:48,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:48,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:48,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:48,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:48,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-28 05:55:48,258 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-28 05:55:48,258 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:48,258 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-28 05:55:48,258 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-28 05:55:48,259 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:48,259 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:48,264 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:48,264 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:48,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:48,264 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:48,264 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:48,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:48,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:48,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:48,266 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-28 05:55:48,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-28 05:55:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-28 05:55:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-28 05:55:48,266 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:48,266 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. started... 2023-03-28 05:55:48,266 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:48,267 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. started... 2023-03-28 05:55:48,268 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:48,269 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:48,269 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 005d70613c3a21956f06dc3c182dc772 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:55:48,269 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5c16240836799dbf440abc94166ed39 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:55:48,269 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:48,269 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. started... 2023-03-28 05:55:48,270 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bcd31990dc0cfde08671d440cb2770 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-28 05:55:48,370 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328ee7b74c4ec0649088366b7610ad9e72b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328ee7b74c4ec0649088366b7610ad9e72b 2023-03-28 05:55:48,389 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328f9f3ab14759449198433c5c467049969 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230328f9f3ab14759449198433c5c467049969 2023-03-28 05:55:48,414 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/3dd07dfa628f416491d5cbcc255fa45b 2023-03-28 05:55:48,462 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032831ab315c48d3469eb89b36d30dcc00e9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023032831ab315c48d3469eb89b36d30dcc00e9 2023-03-28 05:55:48,469 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/19aac4281add47ad85cca11410a729d0 2023-03-28 05:55:48,476 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/3dd07dfa628f416491d5cbcc255fa45b as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3dd07dfa628f416491d5cbcc255fa45b 2023-03-28 05:55:48,506 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3dd07dfa628f416491d5cbcc255fa45b, entries=4, sequenceid=5, filesize=5.5 K 2023-03-28 05:55:48,507 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/19aac4281add47ad85cca11410a729d0 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/19aac4281add47ad85cca11410a729d0 2023-03-28 05:55:48,511 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/19aac4281add47ad85cca11410a729d0, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:55:48,512 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 76bcd31990dc0cfde08671d440cb2770 in 242ms, sequenceid=5, compaction requested=false 2023-03-28 05:55:48,512 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:48,512 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:48,513 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:48,751 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303289ee4cb77c54d4ccbb5c7c61ffb71318d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303289ee4cb77c54d4ccbb5c7c61ffb71318d 2023-03-28 05:55:48,772 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/04c0da30e497456fa55806e6510f3019 2023-03-28 05:55:48,806 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/f859bac444f048698d1dd215067a48bb 2023-03-28 05:55:48,845 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328b56443b677974d439af95b70bc2a86d0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230328b56443b677974d439af95b70bc2a86d0 2023-03-28 05:55:49,209 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032897e295500c81454489536dc91718e008 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023032897e295500c81454489536dc91718e008 2023-03-28 05:55:49,250 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/490e7ba861cb446190604970ac758fd4 2023-03-28 05:55:49,254 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/f859bac444f048698d1dd215067a48bb as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/f859bac444f048698d1dd215067a48bb 2023-03-28 05:55:49,278 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/f859bac444f048698d1dd215067a48bb, entries=4, sequenceid=5, filesize=5.5 K 2023-03-28 05:55:49,279 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/490e7ba861cb446190604970ac758fd4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/490e7ba861cb446190604970ac758fd4 2023-03-28 05:55:49,284 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/490e7ba861cb446190604970ac758fd4, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:55:49,285 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e5c16240836799dbf440abc94166ed39 in 1016ms, sequenceid=5, compaction requested=false 2023-03-28 05:55:49,285 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:49,285 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:49,285 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:49,614 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/5b87088b7f83455bb151b43264a0246f 2023-03-28 05:55:49,618 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/04c0da30e497456fa55806e6510f3019 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/04c0da30e497456fa55806e6510f3019 2023-03-28 05:55:49,652 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/04c0da30e497456fa55806e6510f3019, entries=4, sequenceid=5, filesize=5.5 K 2023-03-28 05:55:49,653 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/5b87088b7f83455bb151b43264a0246f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/5b87088b7f83455bb151b43264a0246f 2023-03-28 05:55:49,657 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/5b87088b7f83455bb151b43264a0246f, entries=2, sequenceid=5, filesize=5.1 K 2023-03-28 05:55:49,658 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 005d70613c3a21956f06dc3c182dc772 in 1389ms, sequenceid=5, compaction requested=false 2023-03-28 05:55:49,658 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:49,658 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:49,658 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:49,658 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:49,658 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,659 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-28 05:55:49,659 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-28 05:55:49,661 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,662 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:49,662 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,662 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:49,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-28 05:55:49,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7daca235[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:49,664 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-28 05:55:49,664 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,665 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,665 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-28 05:55:49,666 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-28 05:55:49,665 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,666 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:49,666 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:49,667 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-28 05:55:49,667 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,667 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:49,667 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-28 05:55:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:49,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-28 05:55:49,670 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-28 05:55:49,670 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:49,670 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:49,670 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-28 05:55:49,670 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:49,673 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,673 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,673 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:49,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:49,673 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:49,674 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:49,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,678 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,678 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:49,678 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:49,678 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:49,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-28 05:55:49,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:49,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:49,678 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-28 05:55:49,678 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:49,678 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:49,678 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:49,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:49,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:49,679 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,679 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,679 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:49,679 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:49,679 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,679 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:49,779 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:49,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:49,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:49,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:49,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:49,783 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:49,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:49,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-28 05:55:49,785 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-28 05:55:49,785 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:49,785 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-28 05:55:49,785 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-28 05:55:49,786 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,786 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:49,787 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:49,787 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:49,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:49,788 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:49,788 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:49,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:49,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:49,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-28 05:55:49,788 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-28 05:55:49,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-28 05:55:49,789 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-28 05:55:49,789 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:49,789 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-28 05:55:49,790 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:49,790 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:49,790 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:49,790 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. started... 2023-03-28 05:55:49,790 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. started... 2023-03-28 05:55:49,790 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:49,790 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:49,790 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bcd31990dc0cfde08671d440cb2770 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:55:49,790 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. started... 2023-03-28 05:55:49,790 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5c16240836799dbf440abc94166ed39 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:55:49,790 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 005d70613c3a21956f06dc3c182dc772 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-28 05:55:50,260 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032848b0e7baec434381b3a179b5b9a5de9c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032848b0e7baec434381b3a179b5b9a5de9c 2023-03-28 05:55:50,262 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032876ce54e8b2f24646a306d3a2a367bb1c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032876ce54e8b2f24646a306d3a2a367bb1c 2023-03-28 05:55:50,273 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328aa48ebb988754b7896f4818398156370 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328aa48ebb988754b7896f4818398156370 2023-03-28 05:55:50,292 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/963a32cd90f541f28c5f8d43c2024425 2023-03-28 05:55:50,681 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/70c36965f90149b99aea8f0420e00480 2023-03-28 05:55:50,682 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/6c61ad2fbd37478387e3910d369baae4 2023-03-28 05:55:50,719 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328825d2e7315544f5bad46a0cfcd5208ce to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230328825d2e7315544f5bad46a0cfcd5208ce 2023-03-28 05:55:50,724 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032812028115c4294115ab03608528cfd652 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023032812028115c4294115ab03608528cfd652 2023-03-28 05:55:50,726 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/e8548f1f54ef4e7b9a8463249849c101 2023-03-28 05:55:50,738 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/70c36965f90149b99aea8f0420e00480 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/70c36965f90149b99aea8f0420e00480 2023-03-28 05:55:50,742 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032843c9f80d28f74cf3b4fc8c930bf4f2da to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023032843c9f80d28f74cf3b4fc8c930bf4f2da 2023-03-28 05:55:50,759 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/c52f245ac9dd4aa68e16239977486dc1 2023-03-28 05:55:50,768 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/963a32cd90f541f28c5f8d43c2024425 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/963a32cd90f541f28c5f8d43c2024425 2023-03-28 05:55:50,781 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/70c36965f90149b99aea8f0420e00480, entries=4, sequenceid=9, filesize=5.5 K 2023-03-28 05:55:50,781 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/e8548f1f54ef4e7b9a8463249849c101 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/e8548f1f54ef4e7b9a8463249849c101 2023-03-28 05:55:50,785 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/e8548f1f54ef4e7b9a8463249849c101, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:55:50,786 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e5c16240836799dbf440abc94166ed39 in 996ms, sequenceid=9, compaction requested=false 2023-03-28 05:55:50,786 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:50,786 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:50,786 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:50,808 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/963a32cd90f541f28c5f8d43c2024425, entries=4, sequenceid=9, filesize=5.5 K 2023-03-28 05:55:50,809 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/c52f245ac9dd4aa68e16239977486dc1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/c52f245ac9dd4aa68e16239977486dc1 2023-03-28 05:55:50,812 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/c52f245ac9dd4aa68e16239977486dc1, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:55:50,813 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 005d70613c3a21956f06dc3c182dc772 in 1023ms, sequenceid=9, compaction requested=false 2023-03-28 05:55:50,813 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:50,813 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:50,813 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:51,132 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/fc19a537943d4eed810606d0d6322399 2023-03-28 05:55:51,137 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/6c61ad2fbd37478387e3910d369baae4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/6c61ad2fbd37478387e3910d369baae4 2023-03-28 05:55:51,162 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/6c61ad2fbd37478387e3910d369baae4, entries=4, sequenceid=9, filesize=5.5 K 2023-03-28 05:55:51,163 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/fc19a537943d4eed810606d0d6322399 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/fc19a537943d4eed810606d0d6322399 2023-03-28 05:55:51,166 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/fc19a537943d4eed810606d0d6322399, entries=2, sequenceid=9, filesize=5.1 K 2023-03-28 05:55:51,167 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 76bcd31990dc0cfde08671d440cb2770 in 1377ms, sequenceid=9, compaction requested=false 2023-03-28 05:55:51,167 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:51,167 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:51,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:51,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:51,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-28 05:55:51,168 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-28 05:55:51,169 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,169 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,170 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:51,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-28 05:55:51,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c008b1a[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:51,171 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-28 05:55:51,171 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,172 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-28 05:55:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-28 05:55:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:51,173 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,173 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:51,175 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-28 05:55:51,175 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,175 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:51,175 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-28 05:55:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:51,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:51,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-28 05:55:51,177 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-28 05:55:51,177 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:51,177 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:51,177 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-28 05:55:51,177 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:51,179 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,179 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:51,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:51,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,179 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:51,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:51,180 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:51,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:51,181 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:51,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:51,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,183 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:51,183 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:51,183 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:51,183 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:51,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:51,183 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:51,184 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:51,184 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,184 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,184 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:51,184 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,183 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-28 05:55:51,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-28 05:55:51,184 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:51,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:51,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:51,184 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:51,184 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:51,284 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:51,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:51,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:51,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:51,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:51,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:51,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:51,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-28 05:55:51,290 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-28 05:55:51,291 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:51,291 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-28 05:55:51,291 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-28 05:55:51,291 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,291 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:51,292 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,292 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:51,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:51,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:51,293 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:51,293 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:51,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:51,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:51,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:51,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:51,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-28 05:55:51,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-28 05:55:51,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-28 05:55:51,294 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-28 05:55:51,294 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:51,294 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-28 05:55:51,294 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:51,294 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:51,295 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:51,295 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:51,295 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:51,294 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. started... 2023-03-28 05:55:51,295 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. started... 2023-03-28 05:55:51,295 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. started... 2023-03-28 05:55:51,295 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5c16240836799dbf440abc94166ed39 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:55:51,295 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 005d70613c3a21956f06dc3c182dc772 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:55:51,295 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bcd31990dc0cfde08671d440cb2770 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-28 05:55:51,379 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328330edd3d568c439cb7245ae525bedd03 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328330edd3d568c439cb7245ae525bedd03 2023-03-28 05:55:51,384 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032805e56898a6884c93b6be56a5d4a1e2f9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032805e56898a6884c93b6be56a5d4a1e2f9 2023-03-28 05:55:51,396 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303285eb75f8d995a441dbaa0d0f6a069c717 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303285eb75f8d995a441dbaa0d0f6a069c717 2023-03-28 05:55:51,438 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/b5d1c48077824e89a2bb2013b19c3099 2023-03-28 05:55:51,492 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032870e9da6d30d2469db793de64fced0a46 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023032870e9da6d30d2469db793de64fced0a46 2023-03-28 05:55:51,822 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/9d6fd76c839f4902903b767fc0fdaf4c 2023-03-28 05:55:51,838 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/c1062f94180e4c718d71426d6d582afe 2023-03-28 05:55:51,867 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303282297935d7fc34a5bbbac6f07c3e21f0f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303282297935d7fc34a5bbbac6f07c3e21f0f 2023-03-28 05:55:51,877 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303284eee9880be6d4c6ba215019b883d498b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303284eee9880be6d4c6ba215019b883d498b 2023-03-28 05:55:51,934 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/8d2bee8123254a7ca6b11c23296f6a99 2023-03-28 05:55:51,938 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/b5d1c48077824e89a2bb2013b19c3099 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b5d1c48077824e89a2bb2013b19c3099 2023-03-28 05:55:51,963 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b5d1c48077824e89a2bb2013b19c3099, entries=4, sequenceid=13, filesize=5.5 K 2023-03-28 05:55:51,964 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/8d2bee8123254a7ca6b11c23296f6a99 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/8d2bee8123254a7ca6b11c23296f6a99 2023-03-28 05:55:51,968 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/8d2bee8123254a7ca6b11c23296f6a99, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:55:51,968 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e5c16240836799dbf440abc94166ed39 in 673ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:51,968 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:51,969 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:51,969 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:52,275 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/52d0e3b8f4ce46c4927bb668921b8bc6 2023-03-28 05:55:52,279 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/9d6fd76c839f4902903b767fc0fdaf4c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/9d6fd76c839f4902903b767fc0fdaf4c 2023-03-28 05:55:52,282 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/e8288d77187249e799fb59fe9155ffe7 2023-03-28 05:55:52,287 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/c1062f94180e4c718d71426d6d582afe as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/c1062f94180e4c718d71426d6d582afe 2023-03-28 05:55:52,310 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/9d6fd76c839f4902903b767fc0fdaf4c, entries=4, sequenceid=13, filesize=5.5 K 2023-03-28 05:55:52,311 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/52d0e3b8f4ce46c4927bb668921b8bc6 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/52d0e3b8f4ce46c4927bb668921b8bc6 2023-03-28 05:55:52,318 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/52d0e3b8f4ce46c4927bb668921b8bc6, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:55:52,319 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 005d70613c3a21956f06dc3c182dc772 in 1024ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:52,319 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:52,319 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:52,319 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:52,320 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/c1062f94180e4c718d71426d6d582afe, entries=4, sequenceid=13, filesize=5.5 K 2023-03-28 05:55:52,320 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/e8288d77187249e799fb59fe9155ffe7 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/e8288d77187249e799fb59fe9155ffe7 2023-03-28 05:55:52,325 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/e8288d77187249e799fb59fe9155ffe7, entries=2, sequenceid=13, filesize=5.1 K 2023-03-28 05:55:52,326 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 76bcd31990dc0cfde08671d440cb2770 in 1031ms, sequenceid=13, compaction requested=true 2023-03-28 05:55:52,326 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:52,326 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-28 05:55:52,327 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-28 05:55:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,331 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:52,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-28 05:55:52,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b5d1ec8[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:52,333 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-28 05:55:52,333 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,336 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-28 05:55:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-28 05:55:52,336 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:52,338 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-28 05:55:52,338 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:52,338 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-28 05:55:52,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-28 05:55:52,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:52,339 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-28 05:55:52,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:52,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:52,339 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-28 05:55:52,339 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:52,341 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,341 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:52,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,341 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:52,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:52,343 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,344 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:52,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:52,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:52,348 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:52,349 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:52,349 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-28 05:55:52,349 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:52,349 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:52,349 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:52,450 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:52,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:52,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:52,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:52,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. with WAL disabled. Data may be lost in the event of a crash. 2023-03-28 05:55:52,462 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:52,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:52,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-28 05:55:52,464 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-28 05:55:52,464 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:52,464 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-28 05:55:52,464 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-28 05:55:52,466 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,466 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:52,470 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,470 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:52,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:52,470 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:52,470 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:52,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:52,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:52,471 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-28 05:55:52,471 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-28 05:55:52,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-28 05:55:52,471 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-28 05:55:52,471 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:52,472 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-28 05:55:52,472 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:52,472 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. started... 2023-03-28 05:55:52,472 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:52,472 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. started... 2023-03-28 05:55:52,472 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5c16240836799dbf440abc94166ed39 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:52,472 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 005d70613c3a21956f06dc3c182dc772 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:52,480 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:52,480 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:52,480 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:52,480 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. started... 2023-03-28 05:55:52,480 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bcd31990dc0cfde08671d440cb2770 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-28 05:55:52,553 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328a966a81765bb48de898235260ae3644b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328a966a81765bb48de898235260ae3644b 2023-03-28 05:55:52,864 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-28 05:55:52,948 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303281ae8e61133e344e9a293eaeadf883921 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303281ae8e61133e344e9a293eaeadf883921 2023-03-28 05:55:52,973 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/b7445afc12fd4be6b5f8ec329ef4eac0 2023-03-28 05:55:52,973 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023032883fba2227d3445e1bf73645ef0c8f1c6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032883fba2227d3445e1bf73645ef0c8f1c6 2023-03-28 05:55:53,015 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303281656b0c372914bc98f20b768eab970b6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303281656b0c372914bc98f20b768eab970b6 2023-03-28 05:55:53,020 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/e3e1a5e499984161be27d9f5b10c9c7d 2023-03-28 05:55:53,024 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/b7445afc12fd4be6b5f8ec329ef4eac0 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/b7445afc12fd4be6b5f8ec329ef4eac0 2023-03-28 05:55:53,053 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/b7445afc12fd4be6b5f8ec329ef4eac0, entries=4, sequenceid=17, filesize=5.5 K 2023-03-28 05:55:53,054 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/e3e1a5e499984161be27d9f5b10c9c7d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/e3e1a5e499984161be27d9f5b10c9c7d 2023-03-28 05:55:53,058 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/e3e1a5e499984161be27d9f5b10c9c7d, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:53,060 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 005d70613c3a21956f06dc3c182dc772 in 588ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:53,060 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:53,060 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:53,060 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:53,368 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/3ecce6c1f2f0451a8cce94ddfb63c592 2023-03-28 05:55:53,392 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/b85cf4b343ee48708f8aa3c3213e4e6d 2023-03-28 05:55:53,821 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303283854165068784685a30547f4145d3932 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303283854165068784685a30547f4145d3932 2023-03-28 05:55:53,843 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303286b1c022789924d2f9cac589d68f917c6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303286b1c022789924d2f9cac589d68f917c6 2023-03-28 05:55:54,226 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd 2023-03-28 05:55:54,230 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/3ecce6c1f2f0451a8cce94ddfb63c592 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3ecce6c1f2f0451a8cce94ddfb63c592 2023-03-28 05:55:54,248 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/aafdc7e93c0c43629fb5e023693728dc 2023-03-28 05:55:54,258 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/b85cf4b343ee48708f8aa3c3213e4e6d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b85cf4b343ee48708f8aa3c3213e4e6d 2023-03-28 05:55:54,259 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3ecce6c1f2f0451a8cce94ddfb63c592, entries=4, sequenceid=17, filesize=5.5 K 2023-03-28 05:55:54,261 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd 2023-03-28 05:55:54,266 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:54,267 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 76bcd31990dc0cfde08671d440cb2770 in 1787ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:54,267 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:54,267 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:54,267 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:54,286 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b85cf4b343ee48708f8aa3c3213e4e6d, entries=4, sequenceid=17, filesize=5.5 K 2023-03-28 05:55:54,286 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/aafdc7e93c0c43629fb5e023693728dc as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/aafdc7e93c0c43629fb5e023693728dc 2023-03-28 05:55:54,292 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/aafdc7e93c0c43629fb5e023693728dc, entries=2, sequenceid=17, filesize=5.1 K 2023-03-28 05:55:54,293 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e5c16240836799dbf440abc94166ed39 in 1821ms, sequenceid=17, compaction requested=true 2023-03-28 05:55:54,293 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:54,293 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:54,293 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:54,293 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:54,293 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,293 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-28 05:55:54,293 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-28 05:55:54,295 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,296 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:54,296 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,296 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:54,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-28 05:55:54,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@501fa61e[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:54,298 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-28 05:55:54,298 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,299 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-28 05:55:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-28 05:55:54,299 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:54,300 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,300 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:54,302 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-28 05:55:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:54,302 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-28 05:55:54,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:54,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:54,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:54,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:54,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:54,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-28 05:55:54,306 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-28 05:55:54,306 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:54,306 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:54,306 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-28 05:55:54,306 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:54,307 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,307 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,307 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:54,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:54,308 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:54,310 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:54,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:54,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:54,314 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-28 05:55:54,314 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:54,314 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:54,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:54,314 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:54,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-28 05:55:54,415 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:54,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:54,426 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:54,434 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:54,443 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:54,444 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:54,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-03-28 05:55:54,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-28 05:55:54,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-28 05:55:54,546 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-28 05:55:54,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:54,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-28 05:55:54,546 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-28 05:55:54,550 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,550 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:54,551 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:54,551 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:54,552 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:54,552 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-28 05:55:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:54,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-28 05:55:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:54,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-28 05:55:54,553 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-28 05:55:54,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-28 05:55:54,553 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-28 05:55:54,553 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-28 05:55:54,553 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-28 05:55:54,554 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:54,554 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. started... 2023-03-28 05:55:54,555 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e5c16240836799dbf440abc94166ed39 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:54,555 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:54,555 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. started... 2023-03-28 05:55:54,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-28 05:55:54,555 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-28 05:55:54,555 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:54,555 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 005d70613c3a21956f06dc3c182dc772 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:54,555 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. started... 2023-03-28 05:55:54,555 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 76bcd31990dc0cfde08671d440cb2770 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-28 05:55:55,037 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/42347af14b6343acbbe2f3242d9e5979 2023-03-28 05:55:55,038 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/31654e97ad274210920e307861eaa1fa 2023-03-28 05:55:55,040 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/8f6e57be0bcb410ca7afd3f3920eff97 2023-03-28 05:55:55,075 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31654e97ad274210920e307861eaa1fa 2023-03-28 05:55:55,084 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42347af14b6343acbbe2f3242d9e5979 2023-03-28 05:55:55,109 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f6e57be0bcb410ca7afd3f3920eff97 2023-03-28 05:55:55,138 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/f2f1b819b675420ba9cbb860581159da 2023-03-28 05:55:55,141 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2f1b819b675420ba9cbb860581159da 2023-03-28 05:55:55,142 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/8f6e57be0bcb410ca7afd3f3920eff97 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/8f6e57be0bcb410ca7afd3f3920eff97 2023-03-28 05:55:55,167 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f6e57be0bcb410ca7afd3f3920eff97 2023-03-28 05:55:55,168 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/8f6e57be0bcb410ca7afd3f3920eff97, entries=3, sequenceid=23, filesize=5.2 K 2023-03-28 05:55:55,168 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/f2f1b819b675420ba9cbb860581159da as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/f2f1b819b675420ba9cbb860581159da 2023-03-28 05:55:55,173 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f2f1b819b675420ba9cbb860581159da 2023-03-28 05:55:55,173 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/f2f1b819b675420ba9cbb860581159da, entries=1, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:55,174 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e5c16240836799dbf440abc94166ed39 in 619ms, sequenceid=23, compaction requested=true 2023-03-28 05:55:55,174 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:55,174 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:55,174 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-28 05:55:55,530 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/a6bf51526667496c8e9abe6b5cee7859 2023-03-28 05:55:55,534 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6bf51526667496c8e9abe6b5cee7859 2023-03-28 05:55:55,535 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/31654e97ad274210920e307861eaa1fa as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/31654e97ad274210920e307861eaa1fa 2023-03-28 05:55:55,568 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31654e97ad274210920e307861eaa1fa 2023-03-28 05:55:55,568 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/31654e97ad274210920e307861eaa1fa, entries=3, sequenceid=23, filesize=5.2 K 2023-03-28 05:55:55,569 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/a6bf51526667496c8e9abe6b5cee7859 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/a6bf51526667496c8e9abe6b5cee7859 2023-03-28 05:55:55,574 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6bf51526667496c8e9abe6b5cee7859 2023-03-28 05:55:55,574 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/a6bf51526667496c8e9abe6b5cee7859, entries=1, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:55,575 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 005d70613c3a21956f06dc3c182dc772 in 1020ms, sequenceid=23, compaction requested=true 2023-03-28 05:55:55,575 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:55,575 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:55,575 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-28 05:55:55,929 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/f98bc662bc024f258530608f93492c0c 2023-03-28 05:55:55,933 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f98bc662bc024f258530608f93492c0c 2023-03-28 05:55:55,934 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/42347af14b6343acbbe2f3242d9e5979 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/42347af14b6343acbbe2f3242d9e5979 2023-03-28 05:55:55,958 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42347af14b6343acbbe2f3242d9e5979 2023-03-28 05:55:55,958 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/42347af14b6343acbbe2f3242d9e5979, entries=3, sequenceid=23, filesize=5.2 K 2023-03-28 05:55:55,959 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/f98bc662bc024f258530608f93492c0c as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/f98bc662bc024f258530608f93492c0c 2023-03-28 05:55:55,962 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f98bc662bc024f258530608f93492c0c 2023-03-28 05:55:55,962 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/f98bc662bc024f258530608f93492c0c, entries=1, sequenceid=23, filesize=5.0 K 2023-03-28 05:55:55,963 INFO [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 76bcd31990dc0cfde08671d440cb2770 in 1408ms, sequenceid=23, compaction requested=true 2023-03-28 05:55:55,963 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:55,963 DEBUG [rs(jenkins-hbase4.apache.org,39167,1679982818904)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-28 05:55:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-28 05:55:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-28 05:55:55,963 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-28 05:55:55,965 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,965 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-28 05:55:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:55,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39167,1679982818904' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-28 05:55:55,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48ba0b22[Count = 0] remaining members to acquire global barrier 2023-03-28 05:55:55,967 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-28 05:55:55,967 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,968 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,968 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-28 05:55:55,968 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,968 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-28 05:55:55,968 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-28 05:55:55,968 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,39167,1679982818904' in zk 2023-03-28 05:55:55,970 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-28 05:55:55,970 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,970 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:55,970 DEBUG [member: 'jenkins-hbase4.apache.org,39167,1679982818904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-28 05:55:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:55,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,39167,1679982818904': 2023-03-28 05:55:55,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39167,1679982818904' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-28 05:55:55,973 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-28 05:55:55,973 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-28 05:55:55,973 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-28 05:55:55,973 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-28 05:55:55,973 INFO [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-28 05:55:55,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:55,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-28 05:55:55,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:55,975 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-28 05:55:55,975 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-28 05:55:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-28 05:55:55,976 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-28 05:55:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-28 05:55:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,978 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-28 05:55:55,978 DEBUG [(jenkins-hbase4.apache.org,35293,1679982817593)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-28 05:55:55,978 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-28 05:55:55,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-28 05:55:55,978 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-28 05:55:55,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-28 05:55:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-28 05:55:55,978 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:55,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-28 05:55:55,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:55:55,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,979 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-28 05:55:55,979 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-28 05:55:55,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-28 05:55:55,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-28 05:55:55,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-28 05:55:55,979 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-28 05:55:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-28 05:55:56,079 DEBUG [Listener at localhost/33463] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-28 05:55:56,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35293] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-28 05:55:56,080 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:56,081 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): e5c16240836799dbf440abc94166ed39/family1 is initiating major compaction (all files) 2023-03-28 05:55:56,081 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:56,081 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:56,081 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of e5c16240836799dbf440abc94166ed39/family1 in testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:56,081 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/f859bac444f048698d1dd215067a48bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/70c36965f90149b99aea8f0420e00480, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b5d1c48077824e89a2bb2013b19c3099, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b85cf4b343ee48708f8aa3c3213e4e6d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/8f6e57be0bcb410ca7afd3f3920eff97] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp, totalSize=27.1 K 2023-03-28 05:55:56,081 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting f859bac444f048698d1dd215067a48bb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982948252 2023-03-28 05:55:56,082 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 70c36965f90149b99aea8f0420e00480, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982949781 2023-03-28 05:55:56,082 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting b5d1c48077824e89a2bb2013b19c3099, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982951286 2023-03-28 05:55:56,083 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting b85cf4b343ee48708f8aa3c3213e4e6d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982952456 2023-03-28 05:55:56,083 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 8f6e57be0bcb410ca7afd3f3920eff97, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:56,093 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): e5c16240836799dbf440abc94166ed39#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:56,137 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230328e1e85d130ccb4073aaa8acfaf2d47187_del 2023-03-28 05:55:56,137 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328e1e85d130ccb4073aaa8acfaf2d47187_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328e1e85d130ccb4073aaa8acfaf2d47187_del 2023-03-28 05:55:56,998 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e33d046aec1447d49bab27e606d4c436 2023-03-28 05:55:56,999 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family1/e33d046aec1447d49bab27e606d4c436 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/e33d046aec1447d49bab27e606d4c436 2023-03-28 05:55:57,023 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e33d046aec1447d49bab27e606d4c436 2023-03-28 05:55:57,024 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e5c16240836799dbf440abc94166ed39/family1 of e5c16240836799dbf440abc94166ed39 into e33d046aec1447d49bab27e606d4c436(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:57,024 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:57,024 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:57,025 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): e5c16240836799dbf440abc94166ed39/family2 is initiating major compaction (all files) 2023-03-28 05:55:57,025 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:57,025 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:57,027 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of e5c16240836799dbf440abc94166ed39/family2 in testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:55:57,027 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/490e7ba861cb446190604970ac758fd4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/e8548f1f54ef4e7b9a8463249849c101, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/8d2bee8123254a7ca6b11c23296f6a99, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/aafdc7e93c0c43629fb5e023693728dc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/f2f1b819b675420ba9cbb860581159da] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp, totalSize=25.4 K 2023-03-28 05:55:57,027 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 490e7ba861cb446190604970ac758fd4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982948252 2023-03-28 05:55:57,028 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting e8548f1f54ef4e7b9a8463249849c101, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982949781 2023-03-28 05:55:57,028 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 8d2bee8123254a7ca6b11c23296f6a99, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982951286 2023-03-28 05:55:57,029 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting aafdc7e93c0c43629fb5e023693728dc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982952456 2023-03-28 05:55:57,029 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting f2f1b819b675420ba9cbb860581159da, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:57,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/f859bac444f048698d1dd215067a48bb, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/70c36965f90149b99aea8f0420e00480, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b5d1c48077824e89a2bb2013b19c3099, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b85cf4b343ee48708f8aa3c3213e4e6d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/8f6e57be0bcb410ca7afd3f3920eff97] to archive 2023-03-28 05:55:57,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:57,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/f859bac444f048698d1dd215067a48bb to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/f859bac444f048698d1dd215067a48bb 2023-03-28 05:55:57,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/70c36965f90149b99aea8f0420e00480 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/70c36965f90149b99aea8f0420e00480 2023-03-28 05:55:57,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b5d1c48077824e89a2bb2013b19c3099 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b5d1c48077824e89a2bb2013b19c3099 2023-03-28 05:55:57,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b85cf4b343ee48708f8aa3c3213e4e6d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/b85cf4b343ee48708f8aa3c3213e4e6d 2023-03-28 05:55:57,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/8f6e57be0bcb410ca7afd3f3920eff97 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/8f6e57be0bcb410ca7afd3f3920eff97 2023-03-28 05:55:57,057 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): e5c16240836799dbf440abc94166ed39#family2#compaction#199 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:57,083 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230328bc72732d73504da9925f98a6155da19c_del 2023-03-28 05:55:57,083 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328bc72732d73504da9925f98a6155da19c_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230328bc72732d73504da9925f98a6155da19c_del 2023-03-28 05:55:57,497 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 618a1302f2884e3391eeb647e52016ff 2023-03-28 05:55:57,498 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/.tmp/family2/618a1302f2884e3391eeb647e52016ff as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/618a1302f2884e3391eeb647e52016ff 2023-03-28 05:55:57,501 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 618a1302f2884e3391eeb647e52016ff 2023-03-28 05:55:57,502 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e5c16240836799dbf440abc94166ed39/family2 of e5c16240836799dbf440abc94166ed39 into 618a1302f2884e3391eeb647e52016ff(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:57,502 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:55:57,502 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:57,502 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 005d70613c3a21956f06dc3c182dc772/family1 is initiating major compaction (all files) 2023-03-28 05:55:57,503 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:57,503 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:57,504 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 005d70613c3a21956f06dc3c182dc772/family1 in testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:57,504 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/04c0da30e497456fa55806e6510f3019, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/963a32cd90f541f28c5f8d43c2024425, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/9d6fd76c839f4902903b767fc0fdaf4c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/b7445afc12fd4be6b5f8ec329ef4eac0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/31654e97ad274210920e307861eaa1fa] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp, totalSize=27.1 K 2023-03-28 05:55:57,505 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 04c0da30e497456fa55806e6510f3019, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982948253 2023-03-28 05:55:57,505 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 963a32cd90f541f28c5f8d43c2024425, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982949781 2023-03-28 05:55:57,505 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 9d6fd76c839f4902903b767fc0fdaf4c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982951286 2023-03-28 05:55:57,506 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting b7445afc12fd4be6b5f8ec329ef4eac0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982952457 2023-03-28 05:55:57,506 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 31654e97ad274210920e307861eaa1fa, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:57,515 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 005d70613c3a21956f06dc3c182dc772#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:57,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/490e7ba861cb446190604970ac758fd4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/e8548f1f54ef4e7b9a8463249849c101, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/8d2bee8123254a7ca6b11c23296f6a99, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/aafdc7e93c0c43629fb5e023693728dc, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/f2f1b819b675420ba9cbb860581159da] to archive 2023-03-28 05:55:57,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:57,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/490e7ba861cb446190604970ac758fd4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/490e7ba861cb446190604970ac758fd4 2023-03-28 05:55:57,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/e8548f1f54ef4e7b9a8463249849c101 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/e8548f1f54ef4e7b9a8463249849c101 2023-03-28 05:55:57,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/8d2bee8123254a7ca6b11c23296f6a99 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/8d2bee8123254a7ca6b11c23296f6a99 2023-03-28 05:55:57,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/aafdc7e93c0c43629fb5e023693728dc to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/aafdc7e93c0c43629fb5e023693728dc 2023-03-28 05:55:57,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/f2f1b819b675420ba9cbb860581159da to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family2/f2f1b819b675420ba9cbb860581159da 2023-03-28 05:55:57,586 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328b986b7d26b354dc698de43e51e69ecec_del 2023-03-28 05:55:57,587 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230328b986b7d26b354dc698de43e51e69ecec_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328b986b7d26b354dc698de43e51e69ecec_del 2023-03-28 05:55:58,055 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc1b767176b3484da27df0a15159e86f 2023-03-28 05:55:58,056 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family1/dc1b767176b3484da27df0a15159e86f as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/dc1b767176b3484da27df0a15159e86f 2023-03-28 05:55:58,089 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc1b767176b3484da27df0a15159e86f 2023-03-28 05:55:58,090 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 005d70613c3a21956f06dc3c182dc772/family1 of 005d70613c3a21956f06dc3c182dc772 into dc1b767176b3484da27df0a15159e86f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:58,090 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:58,090 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:58,091 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 005d70613c3a21956f06dc3c182dc772/family2 is initiating major compaction (all files) 2023-03-28 05:55:58,091 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:58,091 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:58,091 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 005d70613c3a21956f06dc3c182dc772/family2 in testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:55:58,091 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/5b87088b7f83455bb151b43264a0246f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/c52f245ac9dd4aa68e16239977486dc1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/52d0e3b8f4ce46c4927bb668921b8bc6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/e3e1a5e499984161be27d9f5b10c9c7d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/a6bf51526667496c8e9abe6b5cee7859] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp, totalSize=25.4 K 2023-03-28 05:55:58,092 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 5b87088b7f83455bb151b43264a0246f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982948253 2023-03-28 05:55:58,093 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting c52f245ac9dd4aa68e16239977486dc1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982949781 2023-03-28 05:55:58,094 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 52d0e3b8f4ce46c4927bb668921b8bc6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982951286 2023-03-28 05:55:58,095 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting e3e1a5e499984161be27d9f5b10c9c7d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982952457 2023-03-28 05:55:58,095 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting a6bf51526667496c8e9abe6b5cee7859, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:58,106 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 005d70613c3a21956f06dc3c182dc772#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:58,118 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023032802123340cad2426dbac63abd542b0b93_del 2023-03-28 05:55:58,119 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023032802123340cad2426dbac63abd542b0b93_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023032802123340cad2426dbac63abd542b0b93_del 2023-03-28 05:55:58,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/04c0da30e497456fa55806e6510f3019, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/963a32cd90f541f28c5f8d43c2024425, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/9d6fd76c839f4902903b767fc0fdaf4c, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/b7445afc12fd4be6b5f8ec329ef4eac0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/31654e97ad274210920e307861eaa1fa] to archive 2023-03-28 05:55:58,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:58,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/04c0da30e497456fa55806e6510f3019 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/04c0da30e497456fa55806e6510f3019 2023-03-28 05:55:58,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/963a32cd90f541f28c5f8d43c2024425 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/963a32cd90f541f28c5f8d43c2024425 2023-03-28 05:55:58,134 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e885be76c3b41b999656a5503c438e4 2023-03-28 05:55:58,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/9d6fd76c839f4902903b767fc0fdaf4c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/9d6fd76c839f4902903b767fc0fdaf4c 2023-03-28 05:55:58,136 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/.tmp/family2/7e885be76c3b41b999656a5503c438e4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/7e885be76c3b41b999656a5503c438e4 2023-03-28 05:55:58,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/b7445afc12fd4be6b5f8ec329ef4eac0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/b7445afc12fd4be6b5f8ec329ef4eac0 2023-03-28 05:55:58,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/31654e97ad274210920e307861eaa1fa to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/31654e97ad274210920e307861eaa1fa 2023-03-28 05:55:58,141 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e885be76c3b41b999656a5503c438e4 2023-03-28 05:55:58,141 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 005d70613c3a21956f06dc3c182dc772/family2 of 005d70613c3a21956f06dc3c182dc772 into 7e885be76c3b41b999656a5503c438e4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:58,142 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:55:58,142 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:58,142 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 76bcd31990dc0cfde08671d440cb2770/family1 is initiating major compaction (all files) 2023-03-28 05:55:58,142 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:58,142 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:58,142 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 76bcd31990dc0cfde08671d440cb2770/family1 in testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:58,142 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3dd07dfa628f416491d5cbcc255fa45b, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/6c61ad2fbd37478387e3910d369baae4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/c1062f94180e4c718d71426d6d582afe, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3ecce6c1f2f0451a8cce94ddfb63c592, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/42347af14b6343acbbe2f3242d9e5979] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp, totalSize=27.1 K 2023-03-28 05:55:58,142 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 3dd07dfa628f416491d5cbcc255fa45b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982948253 2023-03-28 05:55:58,143 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 6c61ad2fbd37478387e3910d369baae4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982949781 2023-03-28 05:55:58,143 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting c1062f94180e4c718d71426d6d582afe, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982951286 2023-03-28 05:55:58,143 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 3ecce6c1f2f0451a8cce94ddfb63c592, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982952457 2023-03-28 05:55:58,144 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 42347af14b6343acbbe2f3242d9e5979, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:58,153 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 76bcd31990dc0cfde08671d440cb2770#family1#compaction#202 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:58,202 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230328e77682ffe8324869a577154c73dcad0c_del 2023-03-28 05:55:58,202 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328e77682ffe8324869a577154c73dcad0c_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230328e77682ffe8324869a577154c73dcad0c_del 2023-03-28 05:55:58,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/5b87088b7f83455bb151b43264a0246f, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/c52f245ac9dd4aa68e16239977486dc1, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/52d0e3b8f4ce46c4927bb668921b8bc6, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/e3e1a5e499984161be27d9f5b10c9c7d, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/a6bf51526667496c8e9abe6b5cee7859] to archive 2023-03-28 05:55:58,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:58,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/5b87088b7f83455bb151b43264a0246f to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/5b87088b7f83455bb151b43264a0246f 2023-03-28 05:55:58,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/c52f245ac9dd4aa68e16239977486dc1 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/c52f245ac9dd4aa68e16239977486dc1 2023-03-28 05:55:58,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/52d0e3b8f4ce46c4927bb668921b8bc6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/52d0e3b8f4ce46c4927bb668921b8bc6 2023-03-28 05:55:58,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/e3e1a5e499984161be27d9f5b10c9c7d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/e3e1a5e499984161be27d9f5b10c9c7d 2023-03-28 05:55:58,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/a6bf51526667496c8e9abe6b5cee7859 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family2/a6bf51526667496c8e9abe6b5cee7859 2023-03-28 05:55:59,064 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e48eea35a43f4c0fbc956265434b4146 2023-03-28 05:55:59,065 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family1/e48eea35a43f4c0fbc956265434b4146 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/e48eea35a43f4c0fbc956265434b4146 2023-03-28 05:55:59,088 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e48eea35a43f4c0fbc956265434b4146 2023-03-28 05:55:59,089 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 76bcd31990dc0cfde08671d440cb2770/family1 of 76bcd31990dc0cfde08671d440cb2770 into e48eea35a43f4c0fbc956265434b4146(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:59,089 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:59,089 DEBUG [Listener at localhost/33463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-28 05:55:59,089 DEBUG [Listener at localhost/33463] regionserver.HStore(1912): 76bcd31990dc0cfde08671d440cb2770/family2 is initiating major compaction (all files) 2023-03-28 05:55:59,090 INFO [Listener at localhost/33463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-28 05:55:59,090 INFO [Listener at localhost/33463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-28 05:55:59,090 INFO [Listener at localhost/33463] regionserver.HRegion(2259): Starting compaction of 76bcd31990dc0cfde08671d440cb2770/family2 in testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:55:59,090 INFO [Listener at localhost/33463] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/19aac4281add47ad85cca11410a729d0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/fc19a537943d4eed810606d0d6322399, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/e8288d77187249e799fb59fe9155ffe7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/f98bc662bc024f258530608f93492c0c] into tmpdir=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp, totalSize=25.4 K 2023-03-28 05:55:59,090 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting 19aac4281add47ad85cca11410a729d0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679982948253 2023-03-28 05:55:59,091 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting fc19a537943d4eed810606d0d6322399, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679982949781 2023-03-28 05:55:59,091 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting e8288d77187249e799fb59fe9155ffe7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679982951286 2023-03-28 05:55:59,091 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting eb30a3d37c1b4a6c804fe062e2bfe7fd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679982952457 2023-03-28 05:55:59,091 DEBUG [Listener at localhost/33463] compactions.Compactor(207): Compacting f98bc662bc024f258530608f93492c0c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-28 05:55:59,100 INFO [Listener at localhost/33463] throttle.PressureAwareThroughputController(145): 76bcd31990dc0cfde08671d440cb2770#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-28 05:55:59,108 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230328cfb8c0d0980f474283d30bc8caed1d86_del 2023-03-28 05:55:59,108 INFO [Listener at localhost/33463] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230328cfb8c0d0980f474283d30bc8caed1d86_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230328cfb8c0d0980f474283d30bc8caed1d86_del 2023-03-28 05:55:59,118 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7215a9d2afa047078bd92597b7cef904 2023-03-28 05:55:59,119 DEBUG [Listener at localhost/33463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/.tmp/family2/7215a9d2afa047078bd92597b7cef904 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/7215a9d2afa047078bd92597b7cef904 2023-03-28 05:55:59,121 INFO [Listener at localhost/33463] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7215a9d2afa047078bd92597b7cef904 2023-03-28 05:55:59,122 INFO [Listener at localhost/33463] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 76bcd31990dc0cfde08671d440cb2770/family2 of 76bcd31990dc0cfde08671d440cb2770 into 7215a9d2afa047078bd92597b7cef904(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-28 05:55:59,122 DEBUG [Listener at localhost/33463] regionserver.HRegion(2289): Compaction status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:55:59,125 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:59,128 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:59,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3dd07dfa628f416491d5cbcc255fa45b, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/6c61ad2fbd37478387e3910d369baae4, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/c1062f94180e4c718d71426d6d582afe, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3ecce6c1f2f0451a8cce94ddfb63c592, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/42347af14b6343acbbe2f3242d9e5979] to archive 2023-03-28 05:55:59,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:59,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3dd07dfa628f416491d5cbcc255fa45b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3dd07dfa628f416491d5cbcc255fa45b 2023-03-28 05:55:59,132 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:55:59,133 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:55:59,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/6c61ad2fbd37478387e3910d369baae4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/6c61ad2fbd37478387e3910d369baae4 2023-03-28 05:55:59,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/c1062f94180e4c718d71426d6d582afe to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/c1062f94180e4c718d71426d6d582afe 2023-03-28 05:55:59,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3ecce6c1f2f0451a8cce94ddfb63c592 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3ecce6c1f2f0451a8cce94ddfb63c592 2023-03-28 05:55:59,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/42347af14b6343acbbe2f3242d9e5979 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/42347af14b6343acbbe2f3242d9e5979 2023-03-28 05:55:59,140 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35293] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2\xEC\xB8\xC6&\xC0\xA6'E\x12J\xC6\xB5t\x89\x02"\x10\x8E#\xFEK XU\xCE\xFC\x80\xFB\x91\xAC\x9DG3*\x10\xDF\xFE:p7fn\xDC\x18=Qs\x97\xF3$\xE92\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-28 05:55:59,141 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/19aac4281add47ad85cca11410a729d0, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/fc19a537943d4eed810606d0d6322399, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/e8288d77187249e799fb59fe9155ffe7, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/f98bc662bc024f258530608f93492c0c] to archive 2023-03-28 05:55:59,144 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:55:59,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/19aac4281add47ad85cca11410a729d0 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/19aac4281add47ad85cca11410a729d0 2023-03-28 05:55:59,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/fc19a537943d4eed810606d0d6322399 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/fc19a537943d4eed810606d0d6322399 2023-03-28 05:55:59,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/e8288d77187249e799fb59fe9155ffe7 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/e8288d77187249e799fb59fe9155ffe7 2023-03-28 05:55:59,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/eb30a3d37c1b4a6c804fe062e2bfe7fd 2023-03-28 05:55:59,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/f98bc662bc024f258530608f93492c0c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family2/f98bc662bc024f258530608f93492c0c 2023-03-28 05:55:59,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-28 05:55:59,171 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-28 05:55:59,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:55:59,172 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679983559172 2023-03-28 05:55:59,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-28 05:55:59,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-28 05:55:59,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230328e1e85d130ccb4073aaa8acfaf2d47187_del 2023-03-28 05:55:59,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230328b986b7d26b354dc698de43e51e69ecec_del 2023-03-28 05:55:59,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230328e77682ffe8324869a577154c73dcad0c_del 2023-03-28 05:55:59,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:55:59,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] zookeeper.ReadOnlyZKClient(139): Connect 0x211afadf to 127.0.0.1:58236 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-28 05:55:59,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f0ad5af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-28 05:55:59,728 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230328 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-28 05:55:59,918 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230328a40affb04eb44167912c05f09ad25a83 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328a40affb04eb44167912c05f09ad25a83 2023-03-28 05:55:59,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:55:59,940 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-28 05:55:59,943 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53474, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-28 05:55:59,951 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-28 05:55:59,954 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35710, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-28 05:55:59,997 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230328/family1/4d7412e16105484286ff06892b4504ab first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-28 05:55:59,999 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230328/family1/4d7412e16105484286ff06892b4504ab}] 2023-03-28 05:56:00,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230328/family1/4d7412e16105484286ff06892b4504ab for inclusion in e5c16240836799dbf440abc94166ed39/family1 2023-03-28 05:56:00,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-28 05:56:00,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first= last=1 2023-03-28 05:56:00,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:56:00,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230328/family1/4d7412e16105484286ff06892b4504ab to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__f1c00jnc0fh2es6r78no801356uqef30377ngb1738c3h5h5tnit27dvqrmn4570/family1/4d7412e16105484286ff06892b4504ab 2023-03-28 05:56:00,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__f1c00jnc0fh2es6r78no801356uqef30377ngb1738c3h5h5tnit27dvqrmn4570/family1/4d7412e16105484286ff06892b4504ab as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/0d3918e0c1f941d7aa1a25f7a80677c5_SeqId_28_ 2023-03-28 05:56:00,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__f1c00jnc0fh2es6r78no801356uqef30377ngb1738c3h5h5tnit27dvqrmn4570/family1/4d7412e16105484286ff06892b4504ab into e5c16240836799dbf440abc94166ed39/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/0d3918e0c1f941d7aa1a25f7a80677c5_SeqId_28_ - updating store file list. 2023-03-28 05:56:00,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/0d3918e0c1f941d7aa1a25f7a80677c5_SeqId_28_ into e5c16240836799dbf440abc94166ed39/family1 2023-03-28 05:56:00,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__f1c00jnc0fh2es6r78no801356uqef30377ngb1738c3h5h5tnit27dvqrmn4570/family1/4d7412e16105484286ff06892b4504ab into e5c16240836799dbf440abc94166ed39/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/family1/0d3918e0c1f941d7aa1a25f7a80677c5_SeqId_28_) 2023-03-28 05:56:00,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__f1c00jnc0fh2es6r78no801356uqef30377ngb1738c3h5h5tnit27dvqrmn4570/family1/4d7412e16105484286ff06892b4504ab 2023-03-28 05:56:00,065 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230328 table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:56:00,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:56:00,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032848b0e7baec434381b3a179b5b9a5de9c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032848b0e7baec434381b3a179b5b9a5de9c 2023-03-28 05:56:00,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303285eb75f8d995a441dbaa0d0f6a069c717 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303285eb75f8d995a441dbaa0d0f6a069c717 2023-03-28 05:56:00,069 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032883fba2227d3445e1bf73645ef0c8f1c6 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023032883fba2227d3445e1bf73645ef0c8f1c6 2023-03-28 05:56:00,070 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328ee7b74c4ec0649088366b7610ad9e72b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328ee7b74c4ec0649088366b7610ad9e72b 2023-03-28 05:56:00,070 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-28 05:56:00,070 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230328' 2023-03-28 05:56:00,070 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230328 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-28 05:56:00,070 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230328 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-28 05:56:00,258 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303281190bc442f1e46eaabbf4c538bd8b946 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303281190bc442f1e46eaabbf4c538bd8b946 2023-03-28 05:56:00,258 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:56:00,315 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230328/family1/d14d6b0553f74a4092d10fed637dcce4 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-28 05:56:00,316 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230328/family1/d14d6b0553f74a4092d10fed637dcce4}] 2023-03-28 05:56:00,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230328/family1/d14d6b0553f74a4092d10fed637dcce4 for inclusion in 005d70613c3a21956f06dc3c182dc772/family1 2023-03-28 05:56:00,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-28 05:56:00,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-28 05:56:00,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:56:00,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230328/family1/d14d6b0553f74a4092d10fed637dcce4 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__blg4ahl3jcu0ngglb0r4rk5uln0aq13qun6i74ndq5b86ufohuepr7bh2f17kmi2/family1/d14d6b0553f74a4092d10fed637dcce4 2023-03-28 05:56:00,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__blg4ahl3jcu0ngglb0r4rk5uln0aq13qun6i74ndq5b86ufohuepr7bh2f17kmi2/family1/d14d6b0553f74a4092d10fed637dcce4 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/61378ebf408240949d3d0d06190ee17d_SeqId_28_ 2023-03-28 05:56:00,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__blg4ahl3jcu0ngglb0r4rk5uln0aq13qun6i74ndq5b86ufohuepr7bh2f17kmi2/family1/d14d6b0553f74a4092d10fed637dcce4 into 005d70613c3a21956f06dc3c182dc772/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/61378ebf408240949d3d0d06190ee17d_SeqId_28_ - updating store file list. 2023-03-28 05:56:00,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/61378ebf408240949d3d0d06190ee17d_SeqId_28_ into 005d70613c3a21956f06dc3c182dc772/family1 2023-03-28 05:56:00,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__blg4ahl3jcu0ngglb0r4rk5uln0aq13qun6i74ndq5b86ufohuepr7bh2f17kmi2/family1/d14d6b0553f74a4092d10fed637dcce4 into 005d70613c3a21956f06dc3c182dc772/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/family1/61378ebf408240949d3d0d06190ee17d_SeqId_28_) 2023-03-28 05:56:00,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__blg4ahl3jcu0ngglb0r4rk5uln0aq13qun6i74ndq5b86ufohuepr7bh2f17kmi2/family1/d14d6b0553f74a4092d10fed637dcce4 2023-03-28 05:56:00,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230328 table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:56:00,396 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:56:00,398 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328330edd3d568c439cb7245ae525bedd03 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328330edd3d568c439cb7245ae525bedd03 2023-03-28 05:56:00,399 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303289ee4cb77c54d4ccbb5c7c61ffb71318d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303289ee4cb77c54d4ccbb5c7c61ffb71318d 2023-03-28 05:56:00,401 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328a966a81765bb48de898235260ae3644b to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328a966a81765bb48de898235260ae3644b 2023-03-28 05:56:00,402 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328aa48ebb988754b7896f4818398156370 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328aa48ebb988754b7896f4818398156370 2023-03-28 05:56:00,402 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-28 05:56:00,402 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230328' 2023-03-28 05:56:00,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230328 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-28 05:56:00,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230328 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-28 05:56:00,611 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023032851d0f4554c3746b0beedc29fcf71a17e to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032851d0f4554c3746b0beedc29fcf71a17e 2023-03-28 05:56:00,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:56:00,653 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230328/family1/5e8f8aa9403d478290617752a02b561d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-28 05:56:00,656 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770., hostname=jenkins-hbase4.apache.org,39167,1679982818904, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230328/family1/5e8f8aa9403d478290617752a02b561d}] 2023-03-28 05:56:00,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(763): Validating hfile at hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230328/family1/5e8f8aa9403d478290617752a02b561d for inclusion in 76bcd31990dc0cfde08671d440cb2770/family1 2023-03-28 05:56:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-28 05:56:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-28 05:56:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegion(2446): Flush status journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:56:00,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230328/family1/5e8f8aa9403d478290617752a02b561d to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__s6ovcveqh7kq8f1ff6b8k0273gmllhfh1rpqoagbqbcdm45ml0gcdksul76q5pur/family1/5e8f8aa9403d478290617752a02b561d 2023-03-28 05:56:00,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__s6ovcveqh7kq8f1ff6b8k0273gmllhfh1rpqoagbqbcdm45ml0gcdksul76q5pur/family1/5e8f8aa9403d478290617752a02b561d as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3568455c6dc9447f9a081a531615d695_SeqId_28_ 2023-03-28 05:56:00,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(849): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__s6ovcveqh7kq8f1ff6b8k0273gmllhfh1rpqoagbqbcdm45ml0gcdksul76q5pur/family1/5e8f8aa9403d478290617752a02b561d into 76bcd31990dc0cfde08671d440cb2770/family1 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3568455c6dc9447f9a081a531615d695_SeqId_28_ - updating store file list. 2023-03-28 05:56:00,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(882): Loaded HFile hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3568455c6dc9447f9a081a531615d695_SeqId_28_ into 76bcd31990dc0cfde08671d440cb2770/family1 2023-03-28 05:56:00,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.HStore(855): Successfully loaded hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__s6ovcveqh7kq8f1ff6b8k0273gmllhfh1rpqoagbqbcdm45ml0gcdksul76q5pur/family1/5e8f8aa9403d478290617752a02b561d into 76bcd31990dc0cfde08671d440cb2770/family1 (new location: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/family1/3568455c6dc9447f9a081a531615d695_SeqId_28_) 2023-03-28 05:56:00,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39167] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/staging/jenkins__testMajorCompactionFromAdmin__s6ovcveqh7kq8f1ff6b8k0273gmllhfh1rpqoagbqbcdm45ml0gcdksul76q5pur/family1/5e8f8aa9403d478290617752a02b561d 2023-03-28 05:56:00,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230328 table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:56:00,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:56:00,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032805e56898a6884c93b6be56a5d4a1e2f9 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032805e56898a6884c93b6be56a5d4a1e2f9 2023-03-28 05:56:00,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303281ae8e61133e344e9a293eaeadf883921 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303281ae8e61133e344e9a293eaeadf883921 2023-03-28 05:56:00,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032876ce54e8b2f24646a306d3a2a367bb1c to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023032876ce54e8b2f24646a306d3a2a367bb1c 2023-03-28 05:56:00,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230328f9f3ab14759449198433c5c467049969 to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230328f9f3ab14759449198433c5c467049969 2023-03-28 05:56:00,717 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-28 05:56:00,717 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230328' 2023-03-28 05:56:00,717 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230328 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-28 05:56:00,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-28 05:56:00,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-28 05:56:00,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328e1e85d130ccb4073aaa8acfaf2d47187_del] 2023-03-28 05:56:00,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:56:00,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328e1e85d130ccb4073aaa8acfaf2d47187_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230328e1e85d130ccb4073aaa8acfaf2d47187_del 2023-03-28 05:56:00,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-28 05:56:00,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328b986b7d26b354dc698de43e51e69ecec_del] 2023-03-28 05:56:00,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:56:00,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328b986b7d26b354dc698de43e51e69ecec_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230328b986b7d26b354dc698de43e51e69ecec_del 2023-03-28 05:56:00,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-28 05:56:00,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230328e77682ffe8324869a577154c73dcad0c_del] 2023-03-28 05:56:00,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] backup.HFileArchiver(360): Archiving compacted files. 2023-03-28 05:56:00,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230328e77682ffe8324869a577154c73dcad0c_del to hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230328e77682ffe8324869a577154c73dcad0c_del 2023-03-28 05:56:00,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-28 05:56:00,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1679982823165] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-28 05:56:00,724 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-28 05:56:00,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 1.5540 sec 2023-03-28 05:56:00,738 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:56:00,740 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:56:00,743 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-28 05:56:00,744 DEBUG [Listener at localhost/33463] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-28 05:56:00,751 INFO [Listener at localhost/33463] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-28 05:56:00,811 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:56:00,822 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x211afadf to 127.0.0.1:58236 2023-03-28 05:56:00,822 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:00,823 INFO [Finalizer] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:56:00,823 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21bf8e25 to 127.0.0.1:58236 2023-03-28 05:56:00,823 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:00,850 INFO [Listener at localhost/33463] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 255), OpenFileDescriptor=653 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=343 (was 303) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=4063 (was 4067) 2023-03-28 05:56:00,851 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x143ae868 to 127.0.0.1:58236 2023-03-28 05:56:00,851 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:00,851 INFO [Listener at localhost/33463] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-28 05:56:00,851 INFO [Listener at localhost/33463] client.ConnectionImplementation(1974): Closing master protocol: MasterService 2023-03-28 05:56:00,851 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x449b853a to 127.0.0.1:58236 2023-03-28 05:56:00,851 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:00,851 DEBUG [Listener at localhost/33463] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-28 05:56:00,851 DEBUG [Listener at localhost/33463] util.JVMClusterUtil(257): Found active master hash=1951822403, stopped=false 2023-03-28 05:56:00,851 INFO [Listener at localhost/33463] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:56:00,856 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-28 05:56:00,856 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-28 05:56:00,856 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:56:00,856 INFO [Listener at localhost/33463] procedure2.ProcedureExecutor(629): Stopping 2023-03-28 05:56:00,856 DEBUG [Listener at localhost/33463] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a840b53 to 127.0.0.1:58236 2023-03-28 05:56:00,857 DEBUG [Listener at localhost/33463] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:00,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-28 05:56:00,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-28 05:56:00,857 INFO [Listener at localhost/33463] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39167,1679982818904' ***** 2023-03-28 05:56:00,857 INFO [Listener at localhost/33463] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-28 05:56:00,858 INFO [RS:0;jenkins-hbase4:39167] regionserver.HeapMemoryManager(220): Stopping 2023-03-28 05:56:00,858 INFO [RS:0;jenkins-hbase4:39167] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-28 05:56:00,858 INFO [RS:0;jenkins-hbase4:39167] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-28 05:56:00,858 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 30e646cafaa19e2927fd54ee364189fa 2023-03-28 05:56:00,859 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 059a3217a2809735664619b21d588755 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 87940ac43ab7a9d87409f4d6e787bb07 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 0926ca83c78808402038919b291142e9 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for afa94645be6bd970c21b5ea8be00e4e4 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for e5c16240836799dbf440abc94166ed39 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 1538c791bf008a0b1c8f2f3b8bee41bb 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 16cde93b0d2500a4100e8c4500f25b5b 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for df36b35bd32c0c4727983225bdf25a02 2023-03-28 05:56:00,859 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 5e7794a565488ca38a96110be8fabfe9 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 7cca9ddfaf173442c42ea7f31de7f024 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 51ab46570fba25557380b69853bf5ba6 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 005d70613c3a21956f06dc3c182dc772 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 76bcd31990dc0cfde08671d440cb2770 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for e5f52d0654050f53e3182942577dbeea 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 2d9e2d69c8fe93609783c176a23cd793 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 2ea176dc8596cbcf3c0937973953a326 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 76bc919d1afa95f1382595342810654d 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 9dfa29c5ad05861af620a7cc800187c7 2023-03-28 05:56:00,860 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:56:00,860 DEBUG [RS:0;jenkins-hbase4:39167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eb5eb04 to 127.0.0.1:58236 2023-03-28 05:56:00,860 DEBUG [RS:0;jenkins-hbase4:39167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:00,861 INFO [RS:0;jenkins-hbase4:39167] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-28 05:56:00,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 30e646cafaa19e2927fd54ee364189fa, disabling compactions & flushes 2023-03-28 05:56:00,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:56:00,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:56:00,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. after waiting 0 ms 2023-03-28 05:56:00,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:56:00,861 INFO [RS:0;jenkins-hbase4:39167] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-28 05:56:00,861 INFO [RS:0;jenkins-hbase4:39167] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-28 05:56:00,861 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-28 05:56:00,870 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-28 05:56:00,879 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-28 05:56:00,879 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-28 05:56:00,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-28 05:56:00,880 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-28 05:56:00,880 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-28 05:56:00,880 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-28 05:56:00,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-03-28 05:56:00,880 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1505): Waiting on 005d70613c3a21956f06dc3c182dc772, 059a3217a2809735664619b21d588755, 0926ca83c78808402038919b291142e9, 1538c791bf008a0b1c8f2f3b8bee41bb, 1588230740, 16cde93b0d2500a4100e8c4500f25b5b, 2d9e2d69c8fe93609783c176a23cd793, 2ea176dc8596cbcf3c0937973953a326, 30e646cafaa19e2927fd54ee364189fa, 51ab46570fba25557380b69853bf5ba6, 5e7794a565488ca38a96110be8fabfe9, 76bc919d1afa95f1382595342810654d, 76bcd31990dc0cfde08671d440cb2770, 7cca9ddfaf173442c42ea7f31de7f024, 87940ac43ab7a9d87409f4d6e787bb07, 9dfa29c5ad05861af620a7cc800187c7, afa94645be6bd970c21b5ea8be00e4e4, df36b35bd32c0c4727983225bdf25a02, e5c16240836799dbf440abc94166ed39, e5f52d0654050f53e3182942577dbeea, f2b46b886f1b7cf3ce6017631b923841 2023-03-28 05:56:00,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/30e646cafaa19e2927fd54ee364189fa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-28 05:56:00,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:56:00,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 30e646cafaa19e2927fd54ee364189fa: 2023-03-28 05:56:00,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1679982853847.30e646cafaa19e2927fd54ee364189fa. 2023-03-28 05:56:00,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 059a3217a2809735664619b21d588755, disabling compactions & flushes 2023-03-28 05:56:00,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:56:00,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:56:00,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. after waiting 0 ms 2023-03-28 05:56:00,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:56:00,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/.tmp/info/7199de906e6143a8b2db60c70e5bf6b9 2023-03-28 05:56:00,942 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7199de906e6143a8b2db60c70e5bf6b9 2023-03-28 05:56:00,944 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-28 05:56:00,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/059a3217a2809735664619b21d588755/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-28 05:56:00,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:56:00,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 059a3217a2809735664619b21d588755: 2023-03-28 05:56:00,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679982877800.059a3217a2809735664619b21d588755. 2023-03-28 05:56:00,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87940ac43ab7a9d87409f4d6e787bb07, disabling compactions & flushes 2023-03-28 05:56:00,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:56:00,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:56:00,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. after waiting 0 ms 2023-03-28 05:56:00,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:56:00,974 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/.tmp/rep_barrier/372986230e05458c932f3b2e382c7950 2023-03-28 05:56:00,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/87940ac43ab7a9d87409f4d6e787bb07/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-28 05:56:00,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:56:00,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87940ac43ab7a9d87409f4d6e787bb07: 2023-03-28 05:56:00,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1679982895009.87940ac43ab7a9d87409f4d6e787bb07. 2023-03-28 05:56:00,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2b46b886f1b7cf3ce6017631b923841, disabling compactions & flushes 2023-03-28 05:56:00,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:56:00,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:56:00,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. after waiting 0 ms 2023-03-28 05:56:00,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:56:00,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 372986230e05458c932f3b2e382c7950 2023-03-28 05:56:00,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/f2b46b886f1b7cf3ce6017631b923841/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-28 05:56:00,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:56:00,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2b46b886f1b7cf3ce6017631b923841: 2023-03-28 05:56:00,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1679982895009.f2b46b886f1b7cf3ce6017631b923841. 2023-03-28 05:56:00,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0926ca83c78808402038919b291142e9, disabling compactions & flushes 2023-03-28 05:56:00,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:56:00,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:56:00,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. after waiting 0 ms 2023-03-28 05:56:00,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:56:00,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0926ca83c78808402038919b291142e9 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-28 05:56:01,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/.tmp/table/a2c62a85d956496b8d3bba8cff52cf51 2023-03-28 05:56:01,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2c62a85d956496b8d3bba8cff52cf51 2023-03-28 05:56:01,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/.tmp/info/43c83d6df2d348c78cdb31daa2797672 2023-03-28 05:56:01,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/.tmp/info/7199de906e6143a8b2db60c70e5bf6b9 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/info/7199de906e6143a8b2db60c70e5bf6b9 2023-03-28 05:56:01,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7199de906e6143a8b2db60c70e5bf6b9 2023-03-28 05:56:01,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/info/7199de906e6143a8b2db60c70e5bf6b9, entries=226, sequenceid=130, filesize=37.9 K 2023-03-28 05:56:01,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/.tmp/info/43c83d6df2d348c78cdb31daa2797672 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/info/43c83d6df2d348c78cdb31daa2797672 2023-03-28 05:56:01,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/.tmp/rep_barrier/372986230e05458c932f3b2e382c7950 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/rep_barrier/372986230e05458c932f3b2e382c7950 2023-03-28 05:56:01,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/info/43c83d6df2d348c78cdb31daa2797672, entries=3, sequenceid=7, filesize=4.8 K 2023-03-28 05:56:01,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 372986230e05458c932f3b2e382c7950 2023-03-28 05:56:01,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 0926ca83c78808402038919b291142e9 in 22ms, sequenceid=7, compaction requested=false 2023-03-28 05:56:01,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/rep_barrier/372986230e05458c932f3b2e382c7950, entries=1, sequenceid=130, filesize=5.0 K 2023-03-28 05:56:01,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/namespace/0926ca83c78808402038919b291142e9/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-28 05:56:01,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:56:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0926ca83c78808402038919b291142e9: 2023-03-28 05:56:01,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/.tmp/table/a2c62a85d956496b8d3bba8cff52cf51 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/table/a2c62a85d956496b8d3bba8cff52cf51 2023-03-28 05:56:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1679982821545.0926ca83c78808402038919b291142e9. 2023-03-28 05:56:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing afa94645be6bd970c21b5ea8be00e4e4, disabling compactions & flushes 2023-03-28 05:56:01,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:56:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:56:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. after waiting 0 ms 2023-03-28 05:56:01,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:56:01,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithWeeklyPolicy/afa94645be6bd970c21b5ea8be00e4e4/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-28 05:56:01,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:56:01,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for afa94645be6bd970c21b5ea8be00e4e4: 2023-03-28 05:56:01,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1679982842454.afa94645be6bd970c21b5ea8be00e4e4. 2023-03-28 05:56:01,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e5c16240836799dbf440abc94166ed39, disabling compactions & flushes 2023-03-28 05:56:01,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:56:01,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:56:01,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. after waiting 0 ms 2023-03-28 05:56:01,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:56:01,035 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2c62a85d956496b8d3bba8cff52cf51 2023-03-28 05:56:01,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/table/a2c62a85d956496b8d3bba8cff52cf51, entries=27, sequenceid=130, filesize=6.6 K 2023-03-28 05:56:01,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 159ms, sequenceid=130, compaction requested=false 2023-03-28 05:56:01,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/e5c16240836799dbf440abc94166ed39/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-28 05:56:01,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:56:01,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e5c16240836799dbf440abc94166ed39: 2023-03-28 05:56:01,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1679982946091.e5c16240836799dbf440abc94166ed39. 2023-03-28 05:56:01,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1538c791bf008a0b1c8f2f3b8bee41bb, disabling compactions & flushes 2023-03-28 05:56:01,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:56:01,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:56:01,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. after waiting 0 ms 2023-03-28 05:56:01,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:56:01,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-28 05:56:01,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/1538c791bf008a0b1c8f2f3b8bee41bb/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-28 05:56:01,064 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-28 05:56:01,065 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-28 05:56:01,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-28 05:56:01,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-28 05:56:01,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:56:01,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1538c791bf008a0b1c8f2f3b8bee41bb: 2023-03-28 05:56:01,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679982823338.1538c791bf008a0b1c8f2f3b8bee41bb. 2023-03-28 05:56:01,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 16cde93b0d2500a4100e8c4500f25b5b, disabling compactions & flushes 2023-03-28 05:56:01,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:56:01,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:56:01,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. after waiting 0 ms 2023-03-28 05:56:01,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:56:01,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMinorCompactionWithMonthlyPolicy/16cde93b0d2500a4100e8c4500f25b5b/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-28 05:56:01,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:56:01,081 DEBUG [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1505): Waiting on 005d70613c3a21956f06dc3c182dc772, 16cde93b0d2500a4100e8c4500f25b5b, 2d9e2d69c8fe93609783c176a23cd793, 2ea176dc8596cbcf3c0937973953a326, 51ab46570fba25557380b69853bf5ba6, 5e7794a565488ca38a96110be8fabfe9, 76bc919d1afa95f1382595342810654d, 76bcd31990dc0cfde08671d440cb2770, 7cca9ddfaf173442c42ea7f31de7f024, 9dfa29c5ad05861af620a7cc800187c7, df36b35bd32c0c4727983225bdf25a02, e5f52d0654050f53e3182942577dbeea 2023-03-28 05:56:01,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 16cde93b0d2500a4100e8c4500f25b5b: 2023-03-28 05:56:01,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1679982933679.16cde93b0d2500a4100e8c4500f25b5b. 2023-03-28 05:56:01,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing df36b35bd32c0c4727983225bdf25a02, disabling compactions & flushes 2023-03-28 05:56:01,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:56:01,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:56:01,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. after waiting 0 ms 2023-03-28 05:56:01,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:56:01,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testCompactionWithHFileLink/df36b35bd32c0c4727983225bdf25a02/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-28 05:56:01,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:56:01,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for df36b35bd32c0c4727983225bdf25a02: 2023-03-28 05:56:01,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1679982895009.df36b35bd32c0c4727983225bdf25a02. 2023-03-28 05:56:01,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e7794a565488ca38a96110be8fabfe9, disabling compactions & flushes 2023-03-28 05:56:01,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:56:01,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:56:01,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. after waiting 0 ms 2023-03-28 05:56:01,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:56:01,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5e7794a565488ca38a96110be8fabfe9/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-28 05:56:01,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:56:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e7794a565488ca38a96110be8fabfe9: 2023-03-28 05:56:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679982865897.5e7794a565488ca38a96110be8fabfe9. 2023-03-28 05:56:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7cca9ddfaf173442c42ea7f31de7f024, disabling compactions & flushes 2023-03-28 05:56:01,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:56:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:56:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. after waiting 0 ms 2023-03-28 05:56:01,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:56:01,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithWeeklyPolicy/7cca9ddfaf173442c42ea7f31de7f024/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-28 05:56:01,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:56:01,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7cca9ddfaf173442c42ea7f31de7f024: 2023-03-28 05:56:01,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1679982857087.7cca9ddfaf173442c42ea7f31de7f024. 2023-03-28 05:56:01,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 51ab46570fba25557380b69853bf5ba6, disabling compactions & flushes 2023-03-28 05:56:01,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:56:01,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:56:01,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. after waiting 0 ms 2023-03-28 05:56:01,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:56:01,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionWithMonthlyPolicy/51ab46570fba25557380b69853bf5ba6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-28 05:56:01,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:56:01,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 51ab46570fba25557380b69853bf5ba6: 2023-03-28 05:56:01,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1679982833830.51ab46570fba25557380b69853bf5ba6. 2023-03-28 05:56:01,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 005d70613c3a21956f06dc3c182dc772, disabling compactions & flushes 2023-03-28 05:56:01,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:56:01,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:56:01,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. after waiting 0 ms 2023-03-28 05:56:01,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:56:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/005d70613c3a21956f06dc3c182dc772/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-28 05:56:01,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:56:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 005d70613c3a21956f06dc3c182dc772: 2023-03-28 05:56:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1679982946091.005d70613c3a21956f06dc3c182dc772. 2023-03-28 05:56:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76bcd31990dc0cfde08671d440cb2770, disabling compactions & flushes 2023-03-28 05:56:01,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:56:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:56:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. after waiting 0 ms 2023-03-28 05:56:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:56:01,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testMajorCompactionFromAdmin/76bcd31990dc0cfde08671d440cb2770/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-28 05:56:01,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:56:01,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76bcd31990dc0cfde08671d440cb2770: 2023-03-28 05:56:01,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1679982946091.76bcd31990dc0cfde08671d440cb2770. 2023-03-28 05:56:01,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e5f52d0654050f53e3182942577dbeea, disabling compactions & flushes 2023-03-28 05:56:01,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:56:01,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:56:01,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. after waiting 0 ms 2023-03-28 05:56:01,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:56:01,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/e5f52d0654050f53e3182942577dbeea/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-28 05:56:01,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:56:01,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e5f52d0654050f53e3182942577dbeea: 2023-03-28 05:56:01,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1679982919804.e5f52d0654050f53e3182942577dbeea. 2023-03-28 05:56:01,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d9e2d69c8fe93609783c176a23cd793, disabling compactions & flushes 2023-03-28 05:56:01,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:56:01,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:56:01,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. after waiting 0 ms 2023-03-28 05:56:01,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:56:01,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/2d9e2d69c8fe93609783c176a23cd793/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-28 05:56:01,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:56:01,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d9e2d69c8fe93609783c176a23cd793: 2023-03-28 05:56:01,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1679982919804.2d9e2d69c8fe93609783c176a23cd793. 2023-03-28 05:56:01,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2ea176dc8596cbcf3c0937973953a326, disabling compactions & flushes 2023-03-28 05:56:01,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:56:01,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:56:01,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. after waiting 0 ms 2023-03-28 05:56:01,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:56:01,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/2ea176dc8596cbcf3c0937973953a326/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-28 05:56:01,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:56:01,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2ea176dc8596cbcf3c0937973953a326: 2023-03-28 05:56:01,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1679982853847.2ea176dc8596cbcf3c0937973953a326. 2023-03-28 05:56:01,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76bc919d1afa95f1382595342810654d, disabling compactions & flushes 2023-03-28 05:56:01,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:56:01,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:56:01,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. after waiting 0 ms 2023-03-28 05:56:01,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:56:01,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/ns/testMinorCompaction/76bc919d1afa95f1382595342810654d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-28 05:56:01,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:56:01,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76bc919d1afa95f1382595342810654d: 2023-03-28 05:56:01,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1679982919804.76bc919d1afa95f1382595342810654d. 2023-03-28 05:56:01,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9dfa29c5ad05861af620a7cc800187c7, disabling compactions & flushes 2023-03-28 05:56:01,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:56:01,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:56:01,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. after waiting 0 ms 2023-03-28 05:56:01,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:56:01,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/data/default/testScannerOnBulkLoadRefHFiles/9dfa29c5ad05861af620a7cc800187c7/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-28 05:56:01,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:56:01,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9dfa29c5ad05861af620a7cc800187c7: 2023-03-28 05:56:01,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1679982853847.9dfa29c5ad05861af620a7cc800187c7. 2023-03-28 05:56:01,281 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39167,1679982818904; all regions closed. 2023-03-28 05:56:01,290 DEBUG [RS:0;jenkins-hbase4:39167] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/oldWALs 2023-03-28 05:56:01,291 INFO [RS:0;jenkins-hbase4:39167] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39167%2C1679982818904.meta:.meta(num 1679982821301) 2023-03-28 05:56:01,295 DEBUG [RS:0;jenkins-hbase4:39167] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/oldWALs 2023-03-28 05:56:01,295 INFO [RS:0;jenkins-hbase4:39167] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39167%2C1679982818904:(num 1679982820721) 2023-03-28 05:56:01,295 DEBUG [RS:0;jenkins-hbase4:39167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:01,295 INFO [RS:0;jenkins-hbase4:39167] regionserver.LeaseManager(133): Closed leases 2023-03-28 05:56:01,296 INFO [RS:0;jenkins-hbase4:39167] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-28 05:56:01,297 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-28 05:56:01,297 INFO [RS:0;jenkins-hbase4:39167] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39167 2023-03-28 05:56:01,305 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-28 05:56:01,305 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39167,1679982818904 2023-03-28 05:56:01,305 ERROR [Listener at localhost/33463-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a3e26ea rejected from java.util.concurrent.ThreadPoolExecutor@7e01bd75[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-28 05:56:01,305 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39167,1679982818904] 2023-03-28 05:56:01,306 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-28 05:56:01,306 ERROR [Listener at localhost/33463-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f08c4a rejected from java.util.concurrent.ThreadPoolExecutor@7e01bd75[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-28 05:56:01,306 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39167,1679982818904; numProcessing=1 2023-03-28 05:56:01,308 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39167,1679982818904 already deleted, retry=false 2023-03-28 05:56:01,308 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39167,1679982818904 expired; onlineServers=0 2023-03-28 05:56:01,308 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35293,1679982817593' ***** 2023-03-28 05:56:01,308 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-28 05:56:01,309 DEBUG [M:0;jenkins-hbase4:35293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@356b7878, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-03-28 05:56:01,309 INFO [M:0;jenkins-hbase4:35293] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35293,1679982817593 2023-03-28 05:56:01,309 INFO [M:0;jenkins-hbase4:35293] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35293,1679982817593; all regions closed. 2023-03-28 05:56:01,309 DEBUG [M:0;jenkins-hbase4:35293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-28 05:56:01,309 DEBUG [M:0;jenkins-hbase4:35293] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-28 05:56:01,309 DEBUG [M:0;jenkins-hbase4:35293] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-28 05:56:01,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1679982820428] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1679982820428,5,FailOnTimeoutGroup] 2023-03-28 05:56:01,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1679982820427] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1679982820427,5,FailOnTimeoutGroup] 2023-03-28 05:56:01,309 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-28 05:56:01,309 INFO [M:0;jenkins-hbase4:35293] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-28 05:56:01,309 INFO [M:0;jenkins-hbase4:35293] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-28 05:56:01,310 INFO [M:0;jenkins-hbase4:35293] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-03-28 05:56:01,310 DEBUG [M:0;jenkins-hbase4:35293] master.HMaster(1512): Stopping service threads 2023-03-28 05:56:01,310 INFO [M:0;jenkins-hbase4:35293] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-28 05:56:01,310 ERROR [M:0;jenkins-hbase4:35293] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-28 05:56:01,311 INFO [M:0;jenkins-hbase4:35293] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-28 05:56:01,311 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-28 05:56:01,312 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-28 05:56:01,312 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-28 05:56:01,312 DEBUG [M:0;jenkins-hbase4:35293] zookeeper.ZKUtil(398): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-28 05:56:01,312 WARN [M:0;jenkins-hbase4:35293] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-28 05:56:01,312 INFO [M:0;jenkins-hbase4:35293] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-28 05:56:01,313 INFO [M:0;jenkins-hbase4:35293] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-28 05:56:01,313 DEBUG [M:0;jenkins-hbase4:35293] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-28 05:56:01,313 INFO [M:0;jenkins-hbase4:35293] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:56:01,313 DEBUG [M:0;jenkins-hbase4:35293] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:56:01,313 DEBUG [M:0;jenkins-hbase4:35293] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-28 05:56:01,313 DEBUG [M:0;jenkins-hbase4:35293] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:56:01,313 INFO [M:0;jenkins-hbase4:35293] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.79 KB heapSize=598.45 KB 2023-03-28 05:56:01,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-28 05:56:01,322 INFO [M:0;jenkins-hbase4:35293] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.79 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/04293cb1af504c18b6077fdeaf083913 2023-03-28 05:56:01,327 INFO [M:0;jenkins-hbase4:35293] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04293cb1af504c18b6077fdeaf083913 2023-03-28 05:56:01,328 DEBUG [M:0;jenkins-hbase4:35293] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/04293cb1af504c18b6077fdeaf083913 as hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/04293cb1af504c18b6077fdeaf083913 2023-03-28 05:56:01,331 INFO [M:0;jenkins-hbase4:35293] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04293cb1af504c18b6077fdeaf083913 2023-03-28 05:56:01,331 INFO [M:0;jenkins-hbase4:35293] regionserver.HStore(1080): Added hdfs://localhost:44787/user/jenkins/test-data/7acad263-22ea-ad41-e0ee-06d919cbd5de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/04293cb1af504c18b6077fdeaf083913, entries=123, sequenceid=1005, filesize=33.3 K 2023-03-28 05:56:01,332 INFO [M:0;jenkins-hbase4:35293] regionserver.HRegion(2948): Finished flush of dataSize ~512.79 KB/525098, heapSize ~598.44 KB/612800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=1005, compaction requested=false 2023-03-28 05:56:01,337 INFO [M:0;jenkins-hbase4:35293] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-28 05:56:01,337 DEBUG [M:0;jenkins-hbase4:35293] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-28 05:56:01,348 INFO [M:0;jenkins-hbase4:35293] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-28 05:56:01,348 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-28 05:56:01,349 INFO [M:0;jenkins-hbase4:35293] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35293 2023-03-28 05:56:01,350 DEBUG [M:0;jenkins-hbase4:35293] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35293,1679982817593 already deleted, retry=false 2023-03-28 05:56:01,407 INFO [RS:0;jenkins-hbase4:39167] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39167,1679982818904; zookeeper connection closed. 2023-03-28 05:56:01,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-28 05:56:01,408 ERROR [Listener at localhost/33463-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79eb0dd6 rejected from java.util.concurrent.ThreadPoolExecutor@7e01bd75[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-28 05:56:01,408 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): regionserver:39167-0x10129af578b0001, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-28 05:56:01,408 ERROR [Listener at localhost/33463-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e3b966d rejected from java.util.concurrent.ThreadPoolExecutor@7e01bd75[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-28 05:56:01,408 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4b66d8b9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4b66d8b9 2023-03-28 05:56:01,409 INFO [Listener at localhost/33463] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-28 05:56:01,507 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-28 05:56:01,507 INFO [M:0;jenkins-hbase4:35293] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35293,1679982817593; zookeeper connection closed. 2023-03-28 05:56:01,507 ERROR [Listener at localhost/33463-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5938a96e rejected from java.util.concurrent.ThreadPoolExecutor@3530e1ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-28 05:56:01,508 DEBUG [Listener at localhost/33463-EventThread] zookeeper.ZKWatcher(600): master:35293-0x10129af578b0000, quorum=127.0.0.1:58236, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-28 05:56:01,508 ERROR [Listener at localhost/33463-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56c307 rejected from java.util.concurrent.ThreadPoolExecutor@3530e1ed[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-28 05:56:01,509 WARN [Listener at localhost/33463] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-28 05:56:01,513 INFO [Listener at localhost/33463] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-28 05:56:01,624 WARN [BP-405173187-172.31.14.131-1679982814185 heartbeating to localhost/127.0.0.1:44787] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-28 05:56:01,624 WARN [BP-405173187-172.31.14.131-1679982814185 heartbeating to localhost/127.0.0.1:44787] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-405173187-172.31.14.131-1679982814185 (Datanode Uuid 4c8d19b4-f876-4384-9144-a38ed36d5b8c) service to localhost/127.0.0.1:44787 2023-03-28 05:56:01,627 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4/dfs/data/data1/current/BP-405173187-172.31.14.131-1679982814185] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-28 05:56:01,627 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0cefcd97-6977-d428-aebb-ca5145d21b0f/cluster_969a2c03-7b95-ab4a-9b29-f6d984f5b1d4/dfs/data/data2/current/BP-405173187-172.31.14.131-1679982814185] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-28 05:56:01,656 INFO [Listener at localhost/33463] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-28 05:56:01,703 INFO [Listener at localhost/33463] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-28 05:56:01,817 INFO [Listener at localhost/33463] hbase.HBaseTestingUtility(1293): Minicluster is down