2023-10-29 23:53:13,854 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-10-29 23:53:14,112 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c 2023-10-29 23:53:14,125 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-29 23:53:14,126 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd, deleteOnExit=true 2023-10-29 23:53:14,126 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-29 23:53:14,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/test.cache.data in system properties and HBase conf 2023-10-29 23:53:14,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/hadoop.tmp.dir in system properties and HBase conf 2023-10-29 23:53:14,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/hadoop.log.dir in system properties and HBase conf 2023-10-29 23:53:14,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-29 23:53:14,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-29 23:53:14,129 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-29 23:53:14,243 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-29 23:53:14,671 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-29 23:53:14,676 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-29 23:53:14,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-29 23:53:14,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-29 23:53:14,677 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-29 23:53:14,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-29 23:53:14,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-29 23:53:14,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-29 23:53:14,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-29 23:53:14,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-29 23:53:14,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/nfs.dump.dir in system properties and HBase conf 2023-10-29 23:53:14,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/java.io.tmpdir in system properties and HBase conf 2023-10-29 23:53:14,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-29 23:53:14,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-29 23:53:14,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-29 23:53:15,297 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-29 23:53:15,301 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-29 23:53:15,618 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-29 23:53:15,790 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-29 23:53:15,809 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-29 23:53:15,849 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-29 23:53:15,881 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/java.io.tmpdir/Jetty_localhost_43287_hdfs____.umn0jo/webapp 2023-10-29 23:53:16,031 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43287 2023-10-29 23:53:16,041 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-29 23:53:16,042 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-29 23:53:16,584 WARN [Listener at localhost/33249] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-29 23:53:16,664 WARN [Listener at localhost/33249] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-29 23:53:16,683 WARN [Listener at localhost/33249] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-29 23:53:16,690 INFO [Listener at localhost/33249] log.Slf4jLog(67): jetty-6.1.26 2023-10-29 23:53:16,696 INFO [Listener at localhost/33249] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/java.io.tmpdir/Jetty_localhost_39287_datanode____5u8vsi/webapp 2023-10-29 23:53:16,801 INFO [Listener at localhost/33249] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39287 2023-10-29 23:53:17,166 WARN [Listener at localhost/45261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-29 23:53:17,699 DEBUG [Listener at localhost/45261] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c 2023-10-29 23:53:17,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x49545fd9a6ac2053: Processing first storage report for DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068 from datanode 502fd5fe-de91-4ff2-9f35-21e49142f8c6 2023-10-29 23:53:17,705 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x49545fd9a6ac2053: from storage DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068 node DatanodeRegistration(127.0.0.1:46737, datanodeUuid=502fd5fe-de91-4ff2-9f35-21e49142f8c6, infoPort=40225, infoSecurePort=0, ipcPort=45261, storageInfo=lv=-57;cid=testClusterID;nsid=730096669;c=1698623595371), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-29 23:53:17,705 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x49545fd9a6ac2053: Processing first storage report for DS-164175aa-292e-436a-ab82-e3d80f409bf7 from datanode 502fd5fe-de91-4ff2-9f35-21e49142f8c6 2023-10-29 23:53:17,705 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x49545fd9a6ac2053: from storage DS-164175aa-292e-436a-ab82-e3d80f409bf7 node DatanodeRegistration(127.0.0.1:46737, datanodeUuid=502fd5fe-de91-4ff2-9f35-21e49142f8c6, infoPort=40225, infoSecurePort=0, ipcPort=45261, storageInfo=lv=-57;cid=testClusterID;nsid=730096669;c=1698623595371), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-29 23:53:17,787 INFO [Listener at localhost/45261] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd/zookeeper_0, clientPort=50259, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-29 23:53:17,802 INFO [Listener at localhost/45261] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50259 2023-10-29 23:53:17,813 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:17,816 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:18,510 INFO [Listener at localhost/45261] util.FSUtils(471): Created version file at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591 with version=8 2023-10-29 23:53:18,510 INFO [Listener at localhost/45261] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/hbase-staging 2023-10-29 23:53:18,824 INFO [Listener at localhost/45261] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-29 23:53:19,282 INFO [Listener at localhost/45261] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-10-29 23:53:19,313 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 23:53:19,314 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-29 23:53:19,314 INFO [Listener at localhost/45261] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-29 23:53:19,314 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 23:53:19,314 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-29 23:53:19,459 INFO [Listener at localhost/45261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-29 23:53:19,532 DEBUG [Listener at localhost/45261] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-29 23:53:19,625 INFO [Listener at localhost/45261] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45019 2023-10-29 23:53:19,635 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:19,637 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:19,659 INFO [Listener at localhost/45261] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45019 connecting to ZooKeeper ensemble=127.0.0.1:50259 2023-10-29 23:53:19,700 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:450190x0, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-29 23:53:19,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45019-0x101949a64680000 connected 2023-10-29 23:53:19,729 DEBUG [Listener at localhost/45261] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 23:53:19,730 DEBUG [Listener at localhost/45261] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 23:53:19,733 DEBUG [Listener at localhost/45261] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-29 23:53:19,741 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45019 2023-10-29 23:53:19,742 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45019 2023-10-29 23:53:19,742 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45019 2023-10-29 23:53:19,742 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45019 2023-10-29 23:53:19,743 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45019 2023-10-29 23:53:19,749 INFO [Listener at localhost/45261] master.HMaster(444): hbase.rootdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591, hbase.cluster.distributed=false 2023-10-29 23:53:19,828 INFO [Listener at localhost/45261] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-10-29 23:53:19,828 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 23:53:19,828 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-29 23:53:19,829 INFO [Listener at localhost/45261] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-29 23:53:19,829 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 23:53:19,829 INFO [Listener at localhost/45261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-29 23:53:19,836 INFO [Listener at localhost/45261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-29 23:53:19,841 INFO [Listener at localhost/45261] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40533 2023-10-29 23:53:19,844 INFO [Listener at localhost/45261] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-29 23:53:19,854 DEBUG [Listener at localhost/45261] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-10-29 23:53:19,855 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:19,858 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:19,861 INFO [Listener at localhost/45261] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40533 connecting to ZooKeeper ensemble=127.0.0.1:50259 2023-10-29 23:53:19,882 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:405330x0, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-29 23:53:19,883 DEBUG [Listener at localhost/45261] zookeeper.ZKUtil(164): regionserver:405330x0, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 23:53:19,897 DEBUG [Listener at localhost/45261] zookeeper.ZKUtil(164): regionserver:405330x0, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 23:53:19,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40533-0x101949a64680001 connected 2023-10-29 23:53:19,898 DEBUG [Listener at localhost/45261] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-29 23:53:19,900 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40533 2023-10-29 23:53:19,901 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40533 2023-10-29 23:53:19,902 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40533 2023-10-29 23:53:19,903 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40533 2023-10-29 23:53:19,903 DEBUG [Listener at localhost/45261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40533 2023-10-29 23:53:19,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:19,914 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-29 23:53:19,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:19,933 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-29 23:53:19,933 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-29 23:53:19,933 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:19,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-29 23:53:19,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45019,1698623598662 from backup master directory 2023-10-29 23:53:19,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-29 23:53:19,938 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:19,938 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-29 23:53:19,939 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-29 23:53:19,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:19,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-29 23:53:19,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-29 23:53:20,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/hbase.id with ID: 691ba13e-5875-41c1-8c8b-48eeb18c9823 2023-10-29 23:53:20,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:20,076 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:20,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4bf6af6b to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:20,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4de5a24c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:20,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-29 23:53:20,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-29 23:53:20,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-29 23:53:20,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-29 23:53:20,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-29 23:53:20,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-29 23:53:20,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 23:53:20,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store-tmp 2023-10-29 23:53:20,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:20,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-29 23:53:20,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:53:20,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:53:20,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-29 23:53:20,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:53:20,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:53:20,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 23:53:20,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/WALs/jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:20,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45019%2C1698623598662, suffix=, logDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/WALs/jenkins-hbase4.apache.org,45019,1698623598662, archiveDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/oldWALs, maxLogs=10 2023-10-29 23:53:20,357 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068,DISK] 2023-10-29 23:53:20,364 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-29 23:53:20,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/WALs/jenkins-hbase4.apache.org,45019,1698623598662/jenkins-hbase4.apache.org%2C45019%2C1698623598662.1698623600310 2023-10-29 23:53:20,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46737,DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068,DISK]] 2023-10-29 23:53:20,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:53:20,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:20,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 23:53:20,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 23:53:20,500 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-29 23:53:20,509 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-29 23:53:20,541 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-29 23:53:20,556 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:20,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-29 23:53:20,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-29 23:53:20,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 23:53:20,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:20,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60620076, jitterRate=-0.09669047594070435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:53:20,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 23:53:20,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-29 23:53:20,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-29 23:53:20,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-29 23:53:20,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-29 23:53:20,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-29 23:53:20,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 40 msec 2023-10-29 23:53:20,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-29 23:53:20,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-29 23:53:20,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-29 23:53:20,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-29 23:53:20,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-29 23:53:20,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-29 23:53:20,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-29 23:53:20,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-29 23:53:20,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:20,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-29 23:53:20,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-29 23:53:20,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-29 23:53:20,750 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-29 23:53:20,750 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-29 23:53:20,750 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:20,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45019,1698623598662, sessionid=0x101949a64680000, setting cluster-up flag (Was=false) 2023-10-29 23:53:20,768 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:20,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-29 23:53:20,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:20,782 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:20,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-29 23:53:20,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:20,796 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp 2023-10-29 23:53:20,816 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(951): ClusterId : 691ba13e-5875-41c1-8c8b-48eeb18c9823 2023-10-29 23:53:20,820 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-29 23:53:20,828 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-29 23:53:20,828 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-29 23:53:20,832 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-29 23:53:20,837 DEBUG [RS:0;jenkins-hbase4:40533] zookeeper.ReadOnlyZKClient(139): Connect 0x6f14fd09 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:20,851 DEBUG [RS:0;jenkins-hbase4:40533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61d31e9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:20,852 DEBUG [RS:0;jenkins-hbase4:40533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65ec9679, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-29 23:53:20,877 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40533 2023-10-29 23:53:20,881 INFO [RS:0;jenkins-hbase4:40533] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-29 23:53:20,882 INFO [RS:0;jenkins-hbase4:40533] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-29 23:53:20,882 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1022): About to register with Master. 2023-10-29 23:53:20,886 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45019,1698623598662 with isa=jenkins-hbase4.apache.org/172.31.14.131:40533, startcode=1698623599827 2023-10-29 23:53:20,907 DEBUG [RS:0;jenkins-hbase4:40533] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-29 23:53:20,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-29 23:53:20,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-29 23:53:20,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-29 23:53:20,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-29 23:53:20,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-29 23:53:20,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-29 23:53:20,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:20,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-29 23:53:20,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:20,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698623630966 2023-10-29 23:53:20,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-29 23:53:20,970 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-29 23:53:20,970 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33351, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-29 23:53:20,970 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-29 23:53:20,976 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-29 23:53:20,978 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45019] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-29 23:53:20,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-29 23:53:20,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-29 23:53:20,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-29 23:53:20,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-29 23:53:20,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-29 23:53:20,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:20,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-29 23:53:20,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-29 23:53:20,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-29 23:53:20,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-29 23:53:20,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-29 23:53:21,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698623601001,5,FailOnTimeoutGroup] 2023-10-29 23:53:21,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698623601004,5,FailOnTimeoutGroup] 2023-10-29 23:53:21,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-29 23:53:21,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,016 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(2830): Master is not running yet 2023-10-29 23:53:21,016 WARN [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-29 23:53:21,117 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45019,1698623598662 with isa=jenkins-hbase4.apache.org/172.31.14.131:40533, startcode=1698623599827 2023-10-29 23:53:21,123 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45019] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:21,131 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591 2023-10-29 23:53:21,131 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33249 2023-10-29 23:53:21,131 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-29 23:53:21,137 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 23:53:21,137 DEBUG [RS:0;jenkins-hbase4:40533] zookeeper.ZKUtil(162): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:21,137 WARN [RS:0;jenkins-hbase4:40533] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-29 23:53:21,138 INFO [RS:0;jenkins-hbase4:40533] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 23:53:21,138 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/WALs/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:21,140 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40533,1698623599827] 2023-10-29 23:53:21,147 DEBUG [RS:0;jenkins-hbase4:40533] zookeeper.ZKUtil(162): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:21,156 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-29 23:53:21,166 INFO [RS:0;jenkins-hbase4:40533] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-29 23:53:21,194 INFO [RS:0;jenkins-hbase4:40533] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-29 23:53:21,198 INFO [RS:0;jenkins-hbase4:40533] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:53:21,199 INFO [RS:0;jenkins-hbase4:40533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,200 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-29 23:53:21,208 INFO [RS:0;jenkins-hbase4:40533] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,208 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,208 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,208 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,209 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,209 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,209 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-29 23:53:21,209 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,209 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,209 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,209 DEBUG [RS:0;jenkins-hbase4:40533] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-29 23:53:21,212 INFO [RS:0;jenkins-hbase4:40533] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,212 INFO [RS:0;jenkins-hbase4:40533] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,212 INFO [RS:0;jenkins-hbase4:40533] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,228 INFO [RS:0;jenkins-hbase4:40533] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-29 23:53:21,230 INFO [RS:0;jenkins-hbase4:40533] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40533,1698623599827-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:21,248 INFO [RS:0;jenkins-hbase4:40533] regionserver.Replication(203): jenkins-hbase4.apache.org,40533,1698623599827 started 2023-10-29 23:53:21,248 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40533,1698623599827, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40533, sessionid=0x101949a64680001 2023-10-29 23:53:21,248 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-29 23:53:21,248 DEBUG [RS:0;jenkins-hbase4:40533] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:21,248 DEBUG [RS:0;jenkins-hbase4:40533] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40533,1698623599827' 2023-10-29 23:53:21,248 DEBUG [RS:0;jenkins-hbase4:40533] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:21,249 DEBUG [RS:0;jenkins-hbase4:40533] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:21,249 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-29 23:53:21,250 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-29 23:53:21,250 DEBUG [RS:0;jenkins-hbase4:40533] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:21,250 DEBUG [RS:0;jenkins-hbase4:40533] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40533,1698623599827' 2023-10-29 23:53:21,250 DEBUG [RS:0;jenkins-hbase4:40533] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 23:53:21,250 DEBUG [RS:0;jenkins-hbase4:40533] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 23:53:21,251 DEBUG [RS:0;jenkins-hbase4:40533] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-29 23:53:21,251 INFO [RS:0;jenkins-hbase4:40533] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-29 23:53:21,251 INFO [RS:0;jenkins-hbase4:40533] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-29 23:53:21,362 INFO [RS:0;jenkins-hbase4:40533] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40533%2C1698623599827, suffix=, logDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/WALs/jenkins-hbase4.apache.org,40533,1698623599827, archiveDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/oldWALs, maxLogs=32 2023-10-29 23:53:21,387 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068,DISK] 2023-10-29 23:53:21,391 INFO [RS:0;jenkins-hbase4:40533] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/WALs/jenkins-hbase4.apache.org,40533,1698623599827/jenkins-hbase4.apache.org%2C40533%2C1698623599827.1698623601364 2023-10-29 23:53:21,391 DEBUG [RS:0;jenkins-hbase4:40533] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46737,DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068,DISK]] 2023-10-29 23:53:21,418 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:21,419 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:21,420 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591 2023-10-29 23:53:21,439 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:21,441 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-29 23:53:21,444 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/info 2023-10-29 23:53:21,446 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-29 23:53:21,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:21,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-29 23:53:21,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/rep_barrier 2023-10-29 23:53:21,451 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-29 23:53:21,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:21,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-29 23:53:21,455 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/table 2023-10-29 23:53:21,455 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-29 23:53:21,456 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:21,458 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740 2023-10-29 23:53:21,459 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740 2023-10-29 23:53:21,463 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-29 23:53:21,465 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-29 23:53:21,469 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:21,470 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62609487, jitterRate=-0.06704594194889069}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-29 23:53:21,470 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-29 23:53:21,470 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-29 23:53:21,471 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-29 23:53:21,471 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-29 23:53:21,471 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-29 23:53:21,471 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-29 23:53:21,472 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-29 23:53:21,472 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-29 23:53:21,478 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-29 23:53:21,478 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-29 23:53:21,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-29 23:53:21,504 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-29 23:53:21,506 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-29 23:53:21,658 DEBUG [jenkins-hbase4:45019] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-10-29 23:53:21,662 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40533,1698623599827, state=OPENING 2023-10-29 23:53:21,670 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-29 23:53:21,672 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:21,672 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-29 23:53:21,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:21,858 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:21,861 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 23:53:21,866 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 23:53:21,880 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-29 23:53:21,880 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 23:53:21,884 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40533%2C1698623599827.meta, suffix=.meta, logDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/WALs/jenkins-hbase4.apache.org,40533,1698623599827, archiveDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/oldWALs, maxLogs=32 2023-10-29 23:53:21,906 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068,DISK] 2023-10-29 23:53:21,914 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/WALs/jenkins-hbase4.apache.org,40533,1698623599827/jenkins-hbase4.apache.org%2C40533%2C1698623599827.meta.1698623601886.meta 2023-10-29 23:53:21,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46737,DS-e7947b2d-a067-47b9-84f2-d1e00fc9a068,DISK]] 2023-10-29 23:53:21,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:53:21,920 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-29 23:53:21,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-29 23:53:21,945 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-29 23:53:21,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-29 23:53:21,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:21,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-29 23:53:21,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-29 23:53:21,958 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-29 23:53:21,961 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/info 2023-10-29 23:53:21,961 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/info 2023-10-29 23:53:21,962 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-29 23:53:21,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:21,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-29 23:53:21,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/rep_barrier 2023-10-29 23:53:21,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/rep_barrier 2023-10-29 23:53:21,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-29 23:53:21,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:21,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-29 23:53:21,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/table 2023-10-29 23:53:21,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/table 2023-10-29 23:53:21,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-29 23:53:21,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:21,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740 2023-10-29 23:53:21,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740 2023-10-29 23:53:21,981 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-29 23:53:21,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-29 23:53:21,988 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71359518, jitterRate=0.06333968043327332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-29 23:53:21,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-29 23:53:22,001 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698623601851 2023-10-29 23:53:22,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-29 23:53:22,022 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-29 23:53:22,022 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40533,1698623599827, state=OPEN 2023-10-29 23:53:22,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-29 23:53:22,025 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-29 23:53:22,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-29 23:53:22,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40533,1698623599827 in 351 msec 2023-10-29 23:53:22,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-29 23:53:22,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 543 msec 2023-10-29 23:53:22,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1750 sec 2023-10-29 23:53:22,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698623602042, completionTime=-1 2023-10-29 23:53:22,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-10-29 23:53:22,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-10-29 23:53:22,122 DEBUG [hconnection-0x73984eae-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:53:22,126 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:53:22,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-10-29 23:53:22,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698623662146 2023-10-29 23:53:22,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698623722146 2023-10-29 23:53:22,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 103 msec 2023-10-29 23:53:22,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45019,1698623598662-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:22,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45019,1698623598662-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:22,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45019,1698623598662-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:22,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45019, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:22,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-29 23:53:22,188 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-29 23:53:22,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-29 23:53:22,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-29 23:53:22,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-29 23:53:22,213 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:53:22,217 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:53:22,245 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:22,248 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800 empty. 2023-10-29 23:53:22,249 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:22,250 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-29 23:53:22,298 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:22,308 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5d4c06575fb129fc87f52ae6d1b5800, NAME => 'hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:53:22,724 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:22,724 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b5d4c06575fb129fc87f52ae6d1b5800, disabling compactions & flushes 2023-10-29 23:53:22,724 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:53:22,724 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:53:22,724 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. after waiting 0 ms 2023-10-29 23:53:22,724 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:53:22,724 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:53:22,724 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b5d4c06575fb129fc87f52ae6d1b5800: 2023-10-29 23:53:22,730 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:53:22,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698623602733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623602733"}]},"ts":"1698623602733"} 2023-10-29 23:53:22,771 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:53:22,773 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:53:22,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623602773"}]},"ts":"1698623602773"} 2023-10-29 23:53:22,782 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-29 23:53:22,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b5d4c06575fb129fc87f52ae6d1b5800, ASSIGN}] 2023-10-29 23:53:22,794 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b5d4c06575fb129fc87f52ae6d1b5800, ASSIGN 2023-10-29 23:53:22,795 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b5d4c06575fb129fc87f52ae6d1b5800, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:53:22,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b5d4c06575fb129fc87f52ae6d1b5800, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:22,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698623602946"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623602946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623602946"}]},"ts":"1698623602946"} 2023-10-29 23:53:22,952 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b5d4c06575fb129fc87f52ae6d1b5800, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:23,106 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:23,112 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:53:23,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5d4c06575fb129fc87f52ae6d1b5800, NAME => 'hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:53:23,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:23,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:23,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:23,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:23,116 INFO [StoreOpener-b5d4c06575fb129fc87f52ae6d1b5800-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:23,119 DEBUG [StoreOpener-b5d4c06575fb129fc87f52ae6d1b5800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/info 2023-10-29 23:53:23,119 DEBUG [StoreOpener-b5d4c06575fb129fc87f52ae6d1b5800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/info 2023-10-29 23:53:23,119 INFO [StoreOpener-b5d4c06575fb129fc87f52ae6d1b5800-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5d4c06575fb129fc87f52ae6d1b5800 columnFamilyName info 2023-10-29 23:53:23,120 INFO [StoreOpener-b5d4c06575fb129fc87f52ae6d1b5800-1] regionserver.HStore(310): Store=b5d4c06575fb129fc87f52ae6d1b5800/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:23,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:23,123 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:23,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:53:23,132 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:23,133 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5d4c06575fb129fc87f52ae6d1b5800; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59654781, jitterRate=-0.11107449233531952}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:53:23,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5d4c06575fb129fc87f52ae6d1b5800: 2023-10-29 23:53:23,135 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800., pid=6, masterSystemTime=1698623603106 2023-10-29 23:53:23,138 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:53:23,138 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:53:23,140 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b5d4c06575fb129fc87f52ae6d1b5800, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:23,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698623603139"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623603139"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623603139"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623603139"}]},"ts":"1698623603139"} 2023-10-29 23:53:23,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-29 23:53:23,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b5d4c06575fb129fc87f52ae6d1b5800, server=jenkins-hbase4.apache.org,40533,1698623599827 in 192 msec 2023-10-29 23:53:23,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-29 23:53:23,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b5d4c06575fb129fc87f52ae6d1b5800, ASSIGN in 356 msec 2023-10-29 23:53:23,152 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:53:23,153 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623603153"}]},"ts":"1698623603153"} 2023-10-29 23:53:23,155 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-29 23:53:23,159 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:53:23,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 959 msec 2023-10-29 23:53:23,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-29 23:53:23,215 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-29 23:53:23,215 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:53:23,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-29 23:53:23,260 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 23:53:23,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 26 msec 2023-10-29 23:53:23,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-29 23:53:23,280 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 23:53:23,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-10-29 23:53:23,295 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-29 23:53:23,297 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-29 23:53:23,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.358sec 2023-10-29 23:53:23,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-29 23:53:23,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-29 23:53:23,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-29 23:53:23,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45019,1698623598662-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-29 23:53:23,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45019,1698623598662-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-29 23:53:23,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-29 23:53:23,322 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(139): Connect 0x2ed7fc80 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:23,327 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b736f4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:23,338 DEBUG [hconnection-0x5cfdaa6d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:53:23,349 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:53:23,359 INFO [Listener at localhost/45261] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:53:23,361 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(139): Connect 0x01f936d5 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:23,368 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@406486f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:23,368 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:53:23,398 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=169, AvailableMemoryMB=14933 2023-10-29 23:53:23,410 DEBUG [Listener at localhost/45261] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:53:23,414 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:53:23,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 23:53:23,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:23,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:53:23,432 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:53:23,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-10-29 23:53:23,434 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:23,436 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88 empty. 2023-10-29 23:53:23,437 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:23,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-10-29 23:53:23,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 23:53:23,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 23:53:23,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 23:53:23,855 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:23,857 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0c28470338353b99d9c310d1396c3e88, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:53:23,869 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:23,869 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 0c28470338353b99d9c310d1396c3e88, disabling compactions & flushes 2023-10-29 23:53:23,869 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:23,870 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:23,870 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. after waiting 0 ms 2023-10-29 23:53:23,870 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:23,870 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:23,870 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:23,874 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:53:23,876 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698623603875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623603875"}]},"ts":"1698623603875"} 2023-10-29 23:53:23,878 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:53:23,880 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:53:23,880 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623603880"}]},"ts":"1698623603880"} 2023-10-29 23:53:23,882 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-10-29 23:53:23,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, ASSIGN}] 2023-10-29 23:53:23,887 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, ASSIGN 2023-10-29 23:53:23,889 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:53:24,040 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0c28470338353b99d9c310d1396c3e88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:24,040 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698623604040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623604040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623604040"}]},"ts":"1698623604040"} 2023-10-29 23:53:24,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0c28470338353b99d9c310d1396c3e88, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:24,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 23:53:24,196 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:24,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:24,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c28470338353b99d9c310d1396c3e88, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:53:24,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:24,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:24,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:24,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:24,206 INFO [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:24,208 DEBUG [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:24,208 DEBUG [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:24,211 INFO [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c28470338353b99d9c310d1396c3e88 columnFamilyName family1 2023-10-29 23:53:24,214 INFO [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] regionserver.HStore(310): Store=0c28470338353b99d9c310d1396c3e88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:24,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:24,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:24,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:24,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:24,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c28470338353b99d9c310d1396c3e88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60342211, jitterRate=-0.10083098709583282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:53:24,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:24,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88., pid=11, masterSystemTime=1698623604196 2023-10-29 23:53:24,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:24,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:24,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0c28470338353b99d9c310d1396c3e88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:24,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698623604233"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623604233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623604233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623604233"}]},"ts":"1698623604233"} 2023-10-29 23:53:24,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-29 23:53:24,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0c28470338353b99d9c310d1396c3e88, server=jenkins-hbase4.apache.org,40533,1698623599827 in 193 msec 2023-10-29 23:53:24,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-29 23:53:24,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, ASSIGN in 355 msec 2023-10-29 23:53:24,245 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:53:24,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623604245"}]},"ts":"1698623604245"} 2023-10-29 23:53:24,247 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-10-29 23:53:24,250 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:53:24,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 823 msec 2023-10-29 23:53:24,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 23:53:24,556 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-10-29 23:53:24,579 DEBUG [hconnection-0x348371eb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:53:24,583 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:53:24,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:24,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,758 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:24,758 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:24,759 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:24,759 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:24,760 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,760 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,762 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:24,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:24,762 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:24,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:24,763 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:24,763 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:24,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:24,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:24,772 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:24,772 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:24,773 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:24,773 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:24,773 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:24,774 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:24,775 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:24,776 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 23:53:25,343 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113027184b3cfb11412b9c278ce01b084f86 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113027184b3cfb11412b9c278ce01b084f86 2023-10-29 23:53:25,357 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/e93881ae738c4b8babb4299f7e0eb4c2 2023-10-29 23:53:25,367 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/e93881ae738c4b8babb4299f7e0eb4c2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e93881ae738c4b8babb4299f7e0eb4c2 2023-10-29 23:53:25,375 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e93881ae738c4b8babb4299f7e0eb4c2, entries=1000, sequenceid=5, filesize=175.8 K 2023-10-29 23:53:25,378 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 602ms, sequenceid=5, compaction requested=false 2023-10-29 23:53:25,380 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:25,382 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:25,382 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:25,385 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,385 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:25,385 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,385 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:25,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:25,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:25,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:25,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:25,387 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:25,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b1707f9[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:25,387 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,390 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:25,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:25,391 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,391 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:25,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:25,393 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:25,393 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,393 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:25,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:25,393 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:25,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:25,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:25,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:25,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:25,397 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:25,397 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:25,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:25,397 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:25,397 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,397 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:25,399 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,399 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:25,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,400 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:25,400 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,402 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:25,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:25,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:25,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,409 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:25,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:25,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:25,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:25,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:25,410 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,410 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,410 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,410 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:25,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:25,411 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:25,411 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:25,512 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:25,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:25,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:25,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:25,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,530 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:25,530 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:25,530 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:25,530 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:25,531 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,531 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,533 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:25,533 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:25,534 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:25,534 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:25,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:25,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,535 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:25,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:25,535 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:25,535 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:25,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:25,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:25,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:25,536 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:25,536 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:25,536 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 23:53:25,962 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e3ccc12fc4ac49b3b1b3d386f9eceed8 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e3ccc12fc4ac49b3b1b3d386f9eceed8 2023-10-29 23:53:26,374 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/d938fbd523c74cc9ba09f6b05fada30f 2023-10-29 23:53:26,383 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/d938fbd523c74cc9ba09f6b05fada30f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d938fbd523c74cc9ba09f6b05fada30f 2023-10-29 23:53:26,391 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d938fbd523c74cc9ba09f6b05fada30f, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 23:53:26,392 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 856ms, sequenceid=9, compaction requested=false 2023-10-29 23:53:26,392 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:26,392 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:26,392 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:26,393 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:26,393 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,393 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:26,393 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,395 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:26,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:26,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:26,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:26,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:26,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:26,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f2ec13c[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:26,397 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:26,397 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,399 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:26,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:26,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:26,399 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,399 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:26,401 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,401 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:26,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:26,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:26,401 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:26,401 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:26,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:26,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:26,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:26,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:26,405 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:26,405 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:26,405 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:26,405 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,405 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:26,411 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,411 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:26,411 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:26,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:26,412 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:26,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,414 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:26,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,418 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,418 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,418 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:26,418 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:26,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:26,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:26,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 23:53:26,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:26,418 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:26,418 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,418 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:26,419 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,419 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,419 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,419 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:26,419 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:26,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:26,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:26,519 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:26,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:26,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:26,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:26,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,531 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:26,531 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:26,531 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:26,532 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:26,532 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,532 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,533 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:26,533 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:26,534 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:26,534 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:26,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:26,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,536 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:26,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:26,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:26,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:26,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:26,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:26,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:26,536 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:26,536 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:26,536 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:26,991 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c354634ad0f24a1e87de644dcfc616ba to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c354634ad0f24a1e87de644dcfc616ba 2023-10-29 23:53:27,403 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/e80dc7b74ece4ba4b7b14dfaafd06acc 2023-10-29 23:53:27,413 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/e80dc7b74ece4ba4b7b14dfaafd06acc as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e80dc7b74ece4ba4b7b14dfaafd06acc 2023-10-29 23:53:27,422 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e80dc7b74ece4ba4b7b14dfaafd06acc, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 23:53:27,423 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 887ms, sequenceid=13, compaction requested=true 2023-10-29 23:53:27,423 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:27,423 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,426 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:27,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:27,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:27,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5596ffc[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:27,428 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:27,429 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,431 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:27,431 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:27,431 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,431 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:27,433 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:27,433 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,433 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:27,433 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:27,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:27,436 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:27,437 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:27,437 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:27,437 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,437 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:27,439 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,439 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,439 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:27,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:27,440 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:27,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,442 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:27,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:27,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,446 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:27,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:27,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:27,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:27,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 23:53:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:27,447 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,447 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,447 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:27,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:27,447 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:27,487 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:53:27,542 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-29 23:53:27,543 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-29 23:53:27,548 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:27,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:27,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:27,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:27,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,559 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:27,560 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:27,560 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:27,560 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:27,561 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,561 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,563 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,563 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:27,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:27,564 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:27,564 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:27,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,565 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,565 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:27,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:27,566 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:27,566 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:27,566 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:27,566 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:27,994 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a8ea3b6c0fbb46e4915b9a7b0e03e115 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a8ea3b6c0fbb46e4915b9a7b0e03e115 2023-10-29 23:53:28,009 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/ef445e76f2f24f6593b2f9c75b2caf7d 2023-10-29 23:53:28,018 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/ef445e76f2f24f6593b2f9c75b2caf7d as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ef445e76f2f24f6593b2f9c75b2caf7d 2023-10-29 23:53:28,026 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ef445e76f2f24f6593b2f9c75b2caf7d, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 23:53:28,027 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 461ms, sequenceid=17, compaction requested=true 2023-10-29 23:53:28,027 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:28,028 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:28,028 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:28,028 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:28,028 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,028 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:28,028 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:28,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,030 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:28,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:28,031 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,031 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:28,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:28,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:28,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:28,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ef731e7[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:28,033 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:28,033 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,035 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,035 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:28,035 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:28,035 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,035 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:28,035 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:28,037 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,037 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:28,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:28,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:28,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:28,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:28,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:28,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:28,042 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:28,042 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:28,042 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:28,042 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,042 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:28,046 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,046 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:28,046 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:28,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:28,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:28,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:28,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:28,047 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:28,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,049 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,054 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,054 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:28,054 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:28,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:28,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:28,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:28,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 23:53:28,054 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:28,054 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,054 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:28,055 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,055 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:28,055 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:28,056 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,056 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:28,056 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:28,156 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:28,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:28,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:28,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:28,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,169 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:28,169 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:28,169 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:28,169 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:28,170 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,170 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,171 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:28,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:28,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:28,172 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,172 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:28,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:28,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,173 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:28,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,173 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:28,173 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:28,174 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:28,177 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:28,177 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:28,177 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:28,177 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:28,177 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:28,605 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228717950c5f9324b42a343f677f93d7e5f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228717950c5f9324b42a343f677f93d7e5f 2023-10-29 23:53:28,618 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/06a5c0849bc1489dadf82ac4fd74415f 2023-10-29 23:53:28,627 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/06a5c0849bc1489dadf82ac4fd74415f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/06a5c0849bc1489dadf82ac4fd74415f 2023-10-29 23:53:28,635 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/06a5c0849bc1489dadf82ac4fd74415f, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 23:53:28,636 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 459ms, sequenceid=21, compaction requested=true 2023-10-29 23:53:28,636 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:28,636 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:28,637 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:28,638 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:28,638 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,638 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:28,638 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:28,644 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,644 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:28,645 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,645 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:28,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:28,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d8ccf0f[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:28,647 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:28,647 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,648 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:28,648 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:28,648 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,648 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:28,650 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:28,650 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,650 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:28,650 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:28,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:28,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:28,653 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:28,653 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:28,653 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:28,653 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,653 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:28,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:28,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:28,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,656 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:28,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:28,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,657 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:28,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,660 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,661 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:28,661 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,661 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:28,661 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,661 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:28,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:28,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:28,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:28,661 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:28,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 23:53:28,661 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,662 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,662 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:28,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:28,662 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:28,662 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:28,762 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:28,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:28,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:28,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:28,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,775 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:28,775 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:28,776 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:28,776 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:28,776 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,776 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,777 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:28,777 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:28,778 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:28,778 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,779 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,779 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:28,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:28,779 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:28,779 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:28,780 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:28,780 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:28,780 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:28,802 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313423f615c545450aac27f7b8c576c051 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313423f615c545450aac27f7b8c576c051 2023-10-29 23:53:28,818 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-29 23:53:28,819 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-29 23:53:29,212 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/143b14544b7944b093da2f710d63390a 2023-10-29 23:53:29,223 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/143b14544b7944b093da2f710d63390a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/143b14544b7944b093da2f710d63390a 2023-10-29 23:53:29,231 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/143b14544b7944b093da2f710d63390a, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 23:53:29,233 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 453ms, sequenceid=25, compaction requested=true 2023-10-29 23:53:29,233 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:29,233 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:29,233 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:29,233 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:29,233 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,234 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:29,234 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:29,235 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,235 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:29,236 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:29,236 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:29,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:29,238 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:29,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64d2daa3[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:29,238 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,239 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,240 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:29,240 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:29,240 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:29,240 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,240 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:29,242 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:29,242 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,242 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:29,242 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:29,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:29,246 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:29,246 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:29,246 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:29,246 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,246 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:29,248 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,248 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:29,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,248 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:29,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:29,249 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:29,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,251 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:29,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,253 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:29,253 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,253 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:29,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:29,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:29,253 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,254 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,254 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:29,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:29,254 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:29,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:29,254 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,255 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,255 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,255 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:29,255 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:29,355 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:29,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:29,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:29,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:29,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,367 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:29,367 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:29,368 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:29,368 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:29,368 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,368 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,370 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,370 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:29,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:29,370 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,370 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:29,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,372 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:29,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,372 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:29,372 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:29,373 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:29,373 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:29,373 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:29,373 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:29,373 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:29,373 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:29,797 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010199ff77c136e34b2b945e5c5ebeec66c4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010199ff77c136e34b2b945e5c5ebeec66c4 2023-10-29 23:53:29,850 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/ecf1b8ace3d148a7bb435f9bdf76f311 2023-10-29 23:53:29,860 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/ecf1b8ace3d148a7bb435f9bdf76f311 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ecf1b8ace3d148a7bb435f9bdf76f311 2023-10-29 23:53:29,870 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ecf1b8ace3d148a7bb435f9bdf76f311, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 23:53:29,871 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 498ms, sequenceid=29, compaction requested=true 2023-10-29 23:53:29,871 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:29,872 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:29,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:29,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:29,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:29,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:29,874 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,874 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:29,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,875 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:29,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:29,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a3a6f4a[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:29,877 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:29,877 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,878 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,879 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:29,879 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:29,879 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:29,879 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,879 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:29,880 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:29,880 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,880 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:29,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:29,881 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:29,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:29,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:29,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:29,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:29,885 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:29,885 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:29,885 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:29,885 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,885 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:29,891 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,891 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:29,891 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:29,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:29,892 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,893 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,898 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,898 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,898 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:29,898 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:29,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:29,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:29,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:29,899 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:29,899 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:29,898 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:29,900 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:29,900 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:29,900 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:29,900 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:29,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:29,900 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,000 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:30,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:30,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,012 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:30,012 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:30,013 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:30,013 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:30,013 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,013 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,015 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:30,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:30,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:30,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,016 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:30,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:30,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:30,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,017 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:30,017 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:30,018 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:30,018 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:30,018 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:30,018 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:30,018 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:30,018 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:30,445 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031f7d33e1b9924e508ab010371fed3108 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031f7d33e1b9924e508ab010371fed3108 2023-10-29 23:53:30,945 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/16829ad6455e4f82ad0a2330e5b87f40 2023-10-29 23:53:30,965 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/16829ad6455e4f82ad0a2330e5b87f40 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/16829ad6455e4f82ad0a2330e5b87f40 2023-10-29 23:53:30,974 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/16829ad6455e4f82ad0a2330e5b87f40, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 23:53:30,975 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 957ms, sequenceid=33, compaction requested=true 2023-10-29 23:53:30,976 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:30,976 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:30,976 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:30,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:30,979 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,979 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:30,979 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,979 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:30,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:30,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:30,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d351be3[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:30,981 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:30,981 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,983 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,983 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:30,983 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:30,983 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,983 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:30,983 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:30,986 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:30,986 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:30,986 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:30,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:30,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:30,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:30,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:30,991 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:30,991 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:30,991 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:30,991 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,991 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:30,993 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,993 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,993 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:30,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:30,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:30,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:30,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,994 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,996 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:30,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:30,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:30,999 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:30,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:30,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:30,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:30,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:31,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 23:53:31,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:31,000 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:31,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:31,000 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,001 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,001 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,001 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:31,001 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:31,001 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,101 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:31,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:31,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:31,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:31,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,114 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:31,114 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:31,115 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:31,115 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:31,115 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,116 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,117 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:31,117 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:31,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:31,118 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,118 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:31,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,119 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,119 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,120 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:31,120 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:31,121 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:31,121 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:31,121 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:31,121 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:31,121 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:31,121 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:31,548 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d5ae35aa9a59450f8a4ef50f95016e4d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907d5ae35aa9a59450f8a4ef50f95016e4d 2023-10-29 23:53:31,558 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/91387fcb94f74c8b9e87085d18ede805 2023-10-29 23:53:31,565 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/91387fcb94f74c8b9e87085d18ede805 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/91387fcb94f74c8b9e87085d18ede805 2023-10-29 23:53:31,571 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/91387fcb94f74c8b9e87085d18ede805, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 23:53:31,572 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 451ms, sequenceid=37, compaction requested=true 2023-10-29 23:53:31,572 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:31,572 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:31,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:31,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:31,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:31,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:31,574 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,574 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:31,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:31,574 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,575 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:31,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:31,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:31,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@263a53fd[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:31,576 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:31,577 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,579 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,579 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:31,579 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:31,579 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:31,579 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,579 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:31,581 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,581 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:31,581 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:31,581 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:31,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:31,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:31,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:31,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:31,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:31,584 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:31,584 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:31,584 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:31,584 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,584 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:31,586 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,586 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:31,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:31,586 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:31,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,586 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:31,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:31,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,588 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 23:53:31,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:31,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:31,591 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:31,591 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:31,592 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:31,592 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:31,592 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:31,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:31,692 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:31,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:31,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:31,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:31,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,708 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:31,708 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:31,708 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 23:53:31,708 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 23:53:31,709 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,709 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,712 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:31,712 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:31,712 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:31,712 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,713 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 23:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:31,714 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 23:53:31,714 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:31,715 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 23:53:31,715 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:31,715 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:31,715 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:31,716 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. started... 2023-10-29 23:53:31,716 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0c28470338353b99d9c310d1396c3e88 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:32,139 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204c1c4c21897c46a6938231941927f37b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204c1c4c21897c46a6938231941927f37b 2023-10-29 23:53:32,548 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/986a3fbcb84a42cda6795b96b441caf5 2023-10-29 23:53:32,556 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/986a3fbcb84a42cda6795b96b441caf5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/986a3fbcb84a42cda6795b96b441caf5 2023-10-29 23:53:32,562 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/986a3fbcb84a42cda6795b96b441caf5, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 23:53:32,564 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0c28470338353b99d9c310d1396c3e88 in 848ms, sequenceid=41, compaction requested=true 2023-10-29 23:53:32,564 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:32,564 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:32,564 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:32,564 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:32,564 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 23:53:32,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 23:53:32,566 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,566 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:32,567 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,567 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:32,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:32,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:32,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 23:53:32,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@544f825b[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:32,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 23:53:32,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,570 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,570 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 23:53:32,570 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 23:53:32,570 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:32,570 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,570 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:32,576 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 23:53:32,576 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,576 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:32,576 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 23:53:32,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:32,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:32,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:32,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:32,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:32,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 23:53:32,580 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 23:53:32,580 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:32,581 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:32,581 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,581 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:32,582 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,582 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:32,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,583 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:32,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:32,583 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:32,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,585 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:32,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,587 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:32,588 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:32,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 23:53:32,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:32,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,588 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:32,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:32,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:32,589 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:32,689 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:32,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:32,695 DEBUG [Listener at localhost/45261] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 23:53:32,698 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 23:53:32,699 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:32,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 23:53:32,713 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 23:53:32,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:32,715 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624212715 2023-10-29 23:53:32,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:53:32,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-29 23:53:32,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:32,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x5ee0c8fb to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:32,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24c9c654, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:32,727 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,813 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e5ecfe2d91f041788f4d8dda853a8161 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103e5ecfe2d91f041788f4d8dda853a8161 2023-10-29 23:53:32,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:32,834 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:53:32,836 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:53:32,847 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:53:32,849 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:53:32,883 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/776f04705bd7495a83f0a30e1725f649 first=Optional[r3] last=Optional[r6] 2023-10-29 23:53:32,896 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/776f04705bd7495a83f0a30e1725f649}] 2023-10-29 23:53:32,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/776f04705bd7495a83f0a30e1725f649 for inclusion in 0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:32,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 23:53:32,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:32,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:32,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/776f04705bd7495a83f0a30e1725f649 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__42ubakdkrkjmgfenjq3qoq6vvja06euq43fc2sru9nikfcpikh1sk4u3gao6qslh/family1/776f04705bd7495a83f0a30e1725f649 2023-10-29 23:53:32,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__42ubakdkrkjmgfenjq3qoq6vvja06euq43fc2sru9nikfcpikh1sk4u3gao6qslh/family1/776f04705bd7495a83f0a30e1725f649 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_ 2023-10-29 23:53:32,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__42ubakdkrkjmgfenjq3qoq6vvja06euq43fc2sru9nikfcpikh1sk4u3gao6qslh/family1/776f04705bd7495a83f0a30e1725f649 into 0c28470338353b99d9c310d1396c3e88/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_ - updating store file list. 2023-10-29 23:53:32,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_ into 0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:32,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__42ubakdkrkjmgfenjq3qoq6vvja06euq43fc2sru9nikfcpikh1sk4u3gao6qslh/family1/776f04705bd7495a83f0a30e1725f649 into 0c28470338353b99d9c310d1396c3e88/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_) 2023-10-29 23:53:32,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__42ubakdkrkjmgfenjq3qoq6vvja06euq43fc2sru9nikfcpikh1sk4u3gao6qslh/family1/776f04705bd7495a83f0a30e1725f649 2023-10-29 23:53:32,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 23:53:32,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 23:53:32,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 0c28470338353b99d9c310d1396c3e88/family1 is initiating minor compaction 2023-10-29 23:53:32,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@546296a7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:32,944 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0c28470338353b99d9c310d1396c3e88/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:32,945 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d938fbd523c74cc9ba09f6b05fada30f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e80dc7b74ece4ba4b7b14dfaafd06acc, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ef445e76f2f24f6593b2f9c75b2caf7d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/06a5c0849bc1489dadf82ac4fd74415f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/143b14544b7944b093da2f710d63390a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ecf1b8ace3d148a7bb435f9bdf76f311, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/16829ad6455e4f82ad0a2330e5b87f40, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/91387fcb94f74c8b9e87085d18ede805, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/986a3fbcb84a42cda6795b96b441caf5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp, totalSize=50.2 K 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d938fbd523c74cc9ba09f6b05fada30f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting e80dc7b74ece4ba4b7b14dfaafd06acc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting ef445e76f2f24f6593b2f9c75b2caf7d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 06a5c0849bc1489dadf82ac4fd74415f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 143b14544b7944b093da2f710d63390a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting ecf1b8ace3d148a7bb435f9bdf76f311, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 16829ad6455e4f82ad0a2330e5b87f40, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 91387fcb94f74c8b9e87085d18ede805, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 986a3fbcb84a42cda6795b96b441caf5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 23:53:32,946 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 23:53:32,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:32,960 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:32,966 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228717950c5f9324b42a343f677f93d7e5f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228717950c5f9324b42a343f677f93d7e5f 2023-10-29 23:53:32,969 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313423f615c545450aac27f7b8c576c051 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512313423f615c545450aac27f7b8c576c051 2023-10-29 23:53:32,971 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010199ff77c136e34b2b945e5c5ebeec66c4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010199ff77c136e34b2b945e5c5ebeec66c4 2023-10-29 23:53:32,973 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031f7d33e1b9924e508ab010371fed3108 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031f7d33e1b9924e508ab010371fed3108 2023-10-29 23:53:32,973 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-10-29 23:53:32,973 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 23:53:32,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:32,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:33,006 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0c28470338353b99d9c310d1396c3e88#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:53:33,434 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/2e440c5e925d4f09a27402c3286f2bf8 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/2e440c5e925d4f09a27402c3286f2bf8 2023-10-29 23:53:33,449 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0c28470338353b99d9c310d1396c3e88/family1 of 0c28470338353b99d9c310d1396c3e88 into 2e440c5e925d4f09a27402c3286f2bf8(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:53:33,449 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:33,451 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698623612943; duration=0sec 2023-10-29 23:53:33,451 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:33,471 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051db2112276824f5bbf1f0e1330f61dbe to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512051db2112276824f5bbf1f0e1330f61dbe 2023-10-29 23:53:33,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:33,525 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/77061b009a96445b931a487b3abb42d0 first=Optional[r00] last=Optional[r2] 2023-10-29 23:53:33,531 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/77061b009a96445b931a487b3abb42d0}] 2023-10-29 23:53:33,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d938fbd523c74cc9ba09f6b05fada30f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e80dc7b74ece4ba4b7b14dfaafd06acc, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ef445e76f2f24f6593b2f9c75b2caf7d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/06a5c0849bc1489dadf82ac4fd74415f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/143b14544b7944b093da2f710d63390a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ecf1b8ace3d148a7bb435f9bdf76f311, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/16829ad6455e4f82ad0a2330e5b87f40, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/91387fcb94f74c8b9e87085d18ede805, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/986a3fbcb84a42cda6795b96b441caf5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_] to archive 2023-10-29 23:53:33,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/77061b009a96445b931a487b3abb42d0 for inclusion in 0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:33,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:33,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d938fbd523c74cc9ba09f6b05fada30f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d938fbd523c74cc9ba09f6b05fada30f 2023-10-29 23:53:33,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 23:53:33,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:33,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:33,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e80dc7b74ece4ba4b7b14dfaafd06acc to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e80dc7b74ece4ba4b7b14dfaafd06acc 2023-10-29 23:53:33,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/77061b009a96445b931a487b3abb42d0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1788l942pkvm2psvigv05udccq1uohfb3ddulb0v67lavep832uuuu26s8gnf5dm/family1/77061b009a96445b931a487b3abb42d0 2023-10-29 23:53:33,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ef445e76f2f24f6593b2f9c75b2caf7d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ef445e76f2f24f6593b2f9c75b2caf7d 2023-10-29 23:53:33,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/06a5c0849bc1489dadf82ac4fd74415f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/06a5c0849bc1489dadf82ac4fd74415f 2023-10-29 23:53:33,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1788l942pkvm2psvigv05udccq1uohfb3ddulb0v67lavep832uuuu26s8gnf5dm/family1/77061b009a96445b931a487b3abb42d0 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_ 2023-10-29 23:53:33,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1788l942pkvm2psvigv05udccq1uohfb3ddulb0v67lavep832uuuu26s8gnf5dm/family1/77061b009a96445b931a487b3abb42d0 into 0c28470338353b99d9c310d1396c3e88/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_ - updating store file list. 2023-10-29 23:53:33,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/143b14544b7944b093da2f710d63390a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/143b14544b7944b093da2f710d63390a 2023-10-29 23:53:33,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ecf1b8ace3d148a7bb435f9bdf76f311 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/ecf1b8ace3d148a7bb435f9bdf76f311 2023-10-29 23:53:33,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/16829ad6455e4f82ad0a2330e5b87f40 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/16829ad6455e4f82ad0a2330e5b87f40 2023-10-29 23:53:33,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_ into 0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:33,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1788l942pkvm2psvigv05udccq1uohfb3ddulb0v67lavep832uuuu26s8gnf5dm/family1/77061b009a96445b931a487b3abb42d0 into 0c28470338353b99d9c310d1396c3e88/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_) 2023-10-29 23:53:33,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1788l942pkvm2psvigv05udccq1uohfb3ddulb0v67lavep832uuuu26s8gnf5dm/family1/77061b009a96445b931a487b3abb42d0 2023-10-29 23:53:33,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 23:53:33,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/91387fcb94f74c8b9e87085d18ede805 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/91387fcb94f74c8b9e87085d18ede805 2023-10-29 23:53:33,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 23:53:33,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 0c28470338353b99d9c310d1396c3e88/family1 is initiating minor compaction (all files) 2023-10-29 23:53:33,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@705947c5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:33,557 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0c28470338353b99d9c310d1396c3e88/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:33,558 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e93881ae738c4b8babb4299f7e0eb4c2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/2e440c5e925d4f09a27402c3286f2bf8, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp, totalSize=358.6 K 2023-10-29 23:53:33,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/986a3fbcb84a42cda6795b96b441caf5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/986a3fbcb84a42cda6795b96b441caf5 2023-10-29 23:53:33,558 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting e93881ae738c4b8babb4299f7e0eb4c2, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823369 2023-10-29 23:53:33,559 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 2e440c5e925d4f09a27402c3286f2bf8, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223369 2023-10-29 23:53:33,559 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fd8b78ba346d4ea996766967ee81382a_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823369 2023-10-29 23:53:33,560 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:33,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/82a8a0f061a446cb9cc7e452b93f8960_SeqId_44_ 2023-10-29 23:53:33,561 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:33,563 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113027184b3cfb11412b9c278ce01b084f86 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113027184b3cfb11412b9c278ce01b084f86 2023-10-29 23:53:33,564 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c354634ad0f24a1e87de644dcfc616ba to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201c354634ad0f24a1e87de644dcfc616ba 2023-10-29 23:53:33,567 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a8ea3b6c0fbb46e4915b9a7b0e03e115 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205a8ea3b6c0fbb46e4915b9a7b0e03e115 2023-10-29 23:53:33,567 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-10-29 23:53:33,567 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 23:53:33,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:33,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:33,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:33,570 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 23:53:33,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 865 msec 2023-10-29 23:53:33,599 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0c28470338353b99d9c310d1396c3e88#family1#compaction#11 average throughput is 6.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:53:33,666 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/.tmp/family1/9994254aa6ec468986a9cd44b593e118 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/9994254aa6ec468986a9cd44b593e118 2023-10-29 23:53:33,677 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0c28470338353b99d9c310d1396c3e88/family1 of 0c28470338353b99d9c310d1396c3e88 into 9994254aa6ec468986a9cd44b593e118(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:53:33,678 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:33,678 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698623613557; duration=0sec 2023-10-29 23:53:33,678 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:33,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e93881ae738c4b8babb4299f7e0eb4c2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/2e440c5e925d4f09a27402c3286f2bf8, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_] to archive 2023-10-29 23:53:33,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:33,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e93881ae738c4b8babb4299f7e0eb4c2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/e93881ae738c4b8babb4299f7e0eb4c2 2023-10-29 23:53:33,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/2e440c5e925d4f09a27402c3286f2bf8 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/2e440c5e925d4f09a27402c3286f2bf8 2023-10-29 23:53:33,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/fd8b78ba346d4ea996766967ee81382a_SeqId_47_ 2023-10-29 23:53:33,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 23:53:33,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:33,780 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-29 23:53:33,781 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:33,782 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-29 23:53:33,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-10-29 23:53:33,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, REOPEN/MOVE}] 2023-10-29 23:53:33,803 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, REOPEN/MOVE 2023-10-29 23:53:33,804 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0c28470338353b99d9c310d1396c3e88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:33,804 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698623613804"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623613804"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623613804"}]},"ts":"1698623613804"} 2023-10-29 23:53:33,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 0c28470338353b99d9c310d1396c3e88, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:33,966 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:33,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c28470338353b99d9c310d1396c3e88, disabling compactions & flushes 2023-10-29 23:53:33,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. after waiting 0 ms 2023-10-29 23:53:33,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:33,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 23:53:33,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:33,977 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0c28470338353b99d9c310d1396c3e88 to self. 2023-10-29 23:53:33,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:33,980 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0c28470338353b99d9c310d1396c3e88, regionState=CLOSED 2023-10-29 23:53:33,980 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698623613980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623613980"}]},"ts":"1698623613980"} 2023-10-29 23:53:33,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-10-29 23:53:33,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 0c28470338353b99d9c310d1396c3e88, server=jenkins-hbase4.apache.org,40533,1698623599827 in 175 msec 2023-10-29 23:53:33,985 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=true 2023-10-29 23:53:34,136 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0c28470338353b99d9c310d1396c3e88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:34,136 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698623614136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623614136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623614136"}]},"ts":"1698623614136"} 2023-10-29 23:53:34,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 0c28470338353b99d9c310d1396c3e88, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:34,292 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:34,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:34,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c28470338353b99d9c310d1396c3e88, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:53:34,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:34,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:34,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:34,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:34,298 INFO [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:34,300 DEBUG [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:34,300 DEBUG [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:34,300 INFO [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c28470338353b99d9c310d1396c3e88 columnFamilyName family1 2023-10-29 23:53:34,308 DEBUG [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/9994254aa6ec468986a9cd44b593e118 2023-10-29 23:53:34,309 INFO [StoreOpener-0c28470338353b99d9c310d1396c3e88-1] regionserver.HStore(310): Store=0c28470338353b99d9c310d1396c3e88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:34,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:34,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:34,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:53:34,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c28470338353b99d9c310d1396c3e88; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61524888, jitterRate=-0.08320772647857666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:53:34,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:34,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88., pid=17, masterSystemTime=1698623614292 2023-10-29 23:53:34,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:34,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:53:34,320 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0c28470338353b99d9c310d1396c3e88, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:34,320 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698623614320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623614320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623614320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623614320"}]},"ts":"1698623614320"} 2023-10-29 23:53:34,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-10-29 23:53:34,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 0c28470338353b99d9c310d1396c3e88, server=jenkins-hbase4.apache.org,40533,1698623599827 in 183 msec 2023-10-29 23:53:34,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-29 23:53:34,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0c28470338353b99d9c310d1396c3e88, REOPEN/MOVE in 523 msec 2023-10-29 23:53:34,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-10-29 23:53:34,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 544 msec 2023-10-29 23:53:34,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 575 msec 2023-10-29 23:53:34,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-10-29 23:53:34,345 INFO [Listener at localhost/45261] compactions.TestMobCompactor(278): alter status finished 2023-10-29 23:53:34,346 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 23:53:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 23:53:34,349 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 23:53:34,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:34,350 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624214350 2023-10-29 23:53:34,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:53:34,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-29 23:53:34,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:34,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x00518424 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:34,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d5c7936, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:34,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,402 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112884f712b648724ca2b0446c391bd2e35e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112884f712b648724ca2b0446c391bd2e35e 2023-10-29 23:53:34,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:34,423 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:53:34,424 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:53:34,433 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:53:34,435 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:53:34,447 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58baf2ef3591463f837e49231a2be1d3 first=Optional[r05] last=Optional[r8] 2023-10-29 23:53:34,448 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58baf2ef3591463f837e49231a2be1d3}] 2023-10-29 23:53:34,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58baf2ef3591463f837e49231a2be1d3 for inclusion in 0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:34,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 23:53:34,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:34,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:53:34,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58baf2ef3591463f837e49231a2be1d3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f15b5452oehpv186d2vqud5cr7ot292irl31k40vrgs6tpro267s5hs4pb5anqc2/family1/58baf2ef3591463f837e49231a2be1d3 2023-10-29 23:53:34,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f15b5452oehpv186d2vqud5cr7ot292irl31k40vrgs6tpro267s5hs4pb5anqc2/family1/58baf2ef3591463f837e49231a2be1d3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d494c555dda2483da96431c48a328b0a_SeqId_53_ 2023-10-29 23:53:34,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f15b5452oehpv186d2vqud5cr7ot292irl31k40vrgs6tpro267s5hs4pb5anqc2/family1/58baf2ef3591463f837e49231a2be1d3 into 0c28470338353b99d9c310d1396c3e88/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d494c555dda2483da96431c48a328b0a_SeqId_53_ - updating store file list. 2023-10-29 23:53:34,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d494c555dda2483da96431c48a328b0a_SeqId_53_ into 0c28470338353b99d9c310d1396c3e88/family1 2023-10-29 23:53:34,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f15b5452oehpv186d2vqud5cr7ot292irl31k40vrgs6tpro267s5hs4pb5anqc2/family1/58baf2ef3591463f837e49231a2be1d3 into 0c28470338353b99d9c310d1396c3e88/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/family1/d494c555dda2483da96431c48a328b0a_SeqId_53_) 2023-10-29 23:53:34,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__f15b5452oehpv186d2vqud5cr7ot292irl31k40vrgs6tpro267s5hs4pb5anqc2/family1/58baf2ef3591463f837e49231a2be1d3 2023-10-29 23:53:34,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:34,475 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:34,477 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204c1c4c21897c46a6938231941927f37b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511204c1c4c21897c46a6938231941927f37b 2023-10-29 23:53:34,479 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e3ccc12fc4ac49b3b1b3d386f9eceed8 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e3ccc12fc4ac49b3b1b3d386f9eceed8 2023-10-29 23:53:34,479 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-10-29 23:53:34,479 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 23:53:34,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 23:53:34,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 23:53:34,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:34,481 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 23:53:34,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 134 msec 2023-10-29 23:53:34,578 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 213) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67546eb7-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34230 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_353601910_17 at /127.0.0.1:34276 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34324 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34366 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x00518424 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1005785718.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x00518424-SendThread(127.0.0.1:50259) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34198 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34304 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34380 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x00518424-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x5ee0c8fb-SendThread(127.0.0.1:50259) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x735638df-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x5ee0c8fb sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1005785718.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x735638df-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67546eb7-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34314 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34426 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x73984eae-shared-pool-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x735638df-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x735638df-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34376 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34338 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34386 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:40533-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x735638df-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67546eb7-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x5ee0c8fb-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34420 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34262 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34408 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=597 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 287), ProcessCount=169 (was 169), AvailableMemoryMB=14864 (was 14933) 2023-10-29 23:53:34,594 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=275, ProcessCount=169, AvailableMemoryMB=14863 2023-10-29 23:53:34,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 23:53:34,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:34,601 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:53:34,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-10-29 23:53:34,602 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:53:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 23:53:34,604 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:34,605 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4 empty. 2023-10-29 23:53:34,605 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:34,605 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-10-29 23:53:34,624 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:34,626 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb493c0b10ea913a02a3d41519407ba4, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:53:34,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 23:53:34,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 23:53:35,039 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:35,039 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing bb493c0b10ea913a02a3d41519407ba4, disabling compactions & flushes 2023-10-29 23:53:35,039 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,039 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,039 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. after waiting 0 ms 2023-10-29 23:53:35,039 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,039 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,039 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:35,043 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:53:35,044 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698623615044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623615044"}]},"ts":"1698623615044"} 2023-10-29 23:53:35,046 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:53:35,048 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:53:35,048 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623615048"}]},"ts":"1698623615048"} 2023-10-29 23:53:35,050 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-29 23:53:35,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=bb493c0b10ea913a02a3d41519407ba4, ASSIGN}] 2023-10-29 23:53:35,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=bb493c0b10ea913a02a3d41519407ba4, ASSIGN 2023-10-29 23:53:35,170 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=bb493c0b10ea913a02a3d41519407ba4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:53:35,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 23:53:35,321 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=bb493c0b10ea913a02a3d41519407ba4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:35,322 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698623615321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623615321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623615321"}]},"ts":"1698623615321"} 2023-10-29 23:53:35,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure bb493c0b10ea913a02a3d41519407ba4, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:35,476 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:35,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb493c0b10ea913a02a3d41519407ba4, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:53:35,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:35,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:35,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:35,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:35,483 INFO [StoreOpener-bb493c0b10ea913a02a3d41519407ba4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:35,485 DEBUG [StoreOpener-bb493c0b10ea913a02a3d41519407ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:35,485 DEBUG [StoreOpener-bb493c0b10ea913a02a3d41519407ba4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:35,486 INFO [StoreOpener-bb493c0b10ea913a02a3d41519407ba4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb493c0b10ea913a02a3d41519407ba4 columnFamilyName family1 2023-10-29 23:53:35,487 INFO [StoreOpener-bb493c0b10ea913a02a3d41519407ba4-1] regionserver.HStore(310): Store=bb493c0b10ea913a02a3d41519407ba4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:35,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:35,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:35,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:53:35,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:35,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb493c0b10ea913a02a3d41519407ba4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59950812, jitterRate=-0.1066632866859436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:53:35,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:35,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4., pid=21, masterSystemTime=1698623615476 2023-10-29 23:53:35,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,499 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=bb493c0b10ea913a02a3d41519407ba4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:35,499 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698623615499"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623615499"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623615499"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623615499"}]},"ts":"1698623615499"} 2023-10-29 23:53:35,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-10-29 23:53:35,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure bb493c0b10ea913a02a3d41519407ba4, server=jenkins-hbase4.apache.org,40533,1698623599827 in 177 msec 2023-10-29 23:53:35,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-10-29 23:53:35,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=bb493c0b10ea913a02a3d41519407ba4, ASSIGN in 337 msec 2023-10-29 23:53:35,507 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:53:35,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623615508"}]},"ts":"1698623615508"} 2023-10-29 23:53:35,509 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-29 23:53:35,530 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:53:35,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 932 msec 2023-10-29 23:53:35,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 23:53:35,710 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-10-29 23:53:35,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,751 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:35,751 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:35,751 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:35,751 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:35,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,788 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:35,788 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:35,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:35,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:35,789 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:35,789 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:35,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:35,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,790 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:35,790 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:35,790 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:35,791 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:35,791 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:35,792 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 23:53:36,231 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113037fc21b8ec35481cb90012f0cc6a526a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113037fc21b8ec35481cb90012f0cc6a526a 2023-10-29 23:53:36,235 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/ab9fd65afdd14b2da1990e1b05dbf018 2023-10-29 23:53:36,241 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/ab9fd65afdd14b2da1990e1b05dbf018 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ab9fd65afdd14b2da1990e1b05dbf018 2023-10-29 23:53:36,247 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ab9fd65afdd14b2da1990e1b05dbf018, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-29 23:53:36,248 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 456ms, sequenceid=5, compaction requested=false 2023-10-29 23:53:36,248 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:36,250 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:36,250 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:36,250 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:36,250 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:36,250 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,250 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:36,250 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:36,253 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,253 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:36,254 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,254 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:36,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:36,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:36,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2df6e7a7[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:36,256 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:36,256 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,259 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,260 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:36,260 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:36,260 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:36,260 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,260 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:36,267 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:36,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:36,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:36,267 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:36,268 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:36,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:36,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:36,271 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:36,271 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:36,271 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:36,271 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,271 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:36,283 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,283 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:36,283 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:36,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:36,284 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,285 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,290 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,291 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:36,291 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,291 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:36,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:36,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:36,291 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:36,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:53:36,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:36,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:36,291 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,292 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,292 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,292 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,292 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:36,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:36,292 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:36,292 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:36,392 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:36,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:36,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:36,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:36,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,404 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:36,405 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:36,405 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:36,405 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:36,406 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,406 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,408 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,408 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:36,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:36,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:36,408 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,408 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:36,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:36,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,410 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:36,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,410 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:36,410 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:36,410 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:36,413 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:36,413 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:36,413 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:36,413 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:36,413 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 23:53:36,831 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285b7b19fd3d544171828c5fef0dc221b4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285b7b19fd3d544171828c5fef0dc221b4 2023-10-29 23:53:36,838 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/223a24309d5642f1882d1a1485f9a7f8 2023-10-29 23:53:36,849 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/223a24309d5642f1882d1a1485f9a7f8 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/223a24309d5642f1882d1a1485f9a7f8 2023-10-29 23:53:36,855 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/223a24309d5642f1882d1a1485f9a7f8, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 23:53:36,856 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 443ms, sequenceid=9, compaction requested=false 2023-10-29 23:53:36,857 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:36,857 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:36,857 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:36,857 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:36,857 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:36,858 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:36,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:36,860 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:36,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:36,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58e90bf9[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:36,862 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:36,862 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,864 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,864 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:36,865 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:36,865 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:36,865 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,865 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:36,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:36,866 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:36,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:36,871 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:36,871 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:36,871 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:36,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:36,871 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,871 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:36,873 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,873 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:36,873 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:36,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:36,874 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,876 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:36,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,884 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,884 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:36,884 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:36,884 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:36,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:36,884 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:36,884 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:36,884 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:36,885 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,885 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,885 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,885 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:36,885 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:36,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:36,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:36,985 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:36,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:36,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:36,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:36,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,995 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:36,995 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:36,996 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:36,996 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:36,996 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,996 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,997 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,997 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:36,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:36,998 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:36,998 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:36,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,999 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:36,999 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:36,999 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:36,999 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:37,000 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:37,000 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:37,000 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:37,000 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:37,000 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:37,000 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:37,417 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a784c779622f4234b00b6128ff337680 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a784c779622f4234b00b6128ff337680 2023-10-29 23:53:37,823 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/864c200b35cf425e9036d411609ff45f 2023-10-29 23:53:37,831 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/864c200b35cf425e9036d411609ff45f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/864c200b35cf425e9036d411609ff45f 2023-10-29 23:53:37,837 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/864c200b35cf425e9036d411609ff45f, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 23:53:37,838 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 838ms, sequenceid=13, compaction requested=true 2023-10-29 23:53:37,839 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:37,839 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:37,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:37,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:37,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:37,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:37,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,842 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:37,842 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,842 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:37,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:37,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:37,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c380ea2[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:37,844 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:37,844 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,845 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,846 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:37,846 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:37,846 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:37,846 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,846 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:37,848 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:37,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:37,848 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:37,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:37,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:37,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:37,852 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:37,852 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:37,852 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:37,852 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,852 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:37,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:37,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:37,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:37,855 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,856 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,860 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,860 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:37,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:37,861 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:37,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:37,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:37,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:37,861 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:37,861 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:37,861 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:37,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:37,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:37,962 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:37,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:37,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:37,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:37,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,971 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:37,972 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:37,972 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:37,972 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:37,973 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,973 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,975 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:37,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:37,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:37,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:37,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:37,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,976 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:37,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:37,976 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:37,976 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:37,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:37,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:37,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:37,977 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:37,977 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:37,977 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:38,393 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120549b7597e539f45418dcbb4112644ef82 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120549b7597e539f45418dcbb4112644ef82 2023-10-29 23:53:38,401 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/850d4bd7d2f74ef38348476c1d0cd9de 2023-10-29 23:53:38,406 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/850d4bd7d2f74ef38348476c1d0cd9de as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/850d4bd7d2f74ef38348476c1d0cd9de 2023-10-29 23:53:38,412 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/850d4bd7d2f74ef38348476c1d0cd9de, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 23:53:38,413 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 436ms, sequenceid=17, compaction requested=true 2023-10-29 23:53:38,413 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:38,413 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:38,413 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:38,413 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:38,413 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,413 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:38,413 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:38,415 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:38,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:38,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:38,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:38,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cd1c24[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:38,417 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:38,417 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,420 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,420 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:38,420 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:38,420 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:38,420 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,420 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:38,422 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:38,422 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:38,422 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,422 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:38,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:38,426 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:38,426 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:38,426 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:38,426 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,426 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:38,428 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,428 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:38,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,428 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:38,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,429 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:38,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,432 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,439 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,439 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:38,440 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,440 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:38,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:38,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:53:38,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:38,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:38,440 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:38,440 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:38,440 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,441 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,441 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,441 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:38,441 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:38,441 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:38,541 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:38,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:38,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:38,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:38,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,552 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:38,552 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:38,552 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:38,553 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:38,553 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,553 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,558 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,558 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:38,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:38,558 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:38,558 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,560 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,560 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:38,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:38,560 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:38,560 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:38,561 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:38,561 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:38,561 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:38,561 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:38,561 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:38,561 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:38,994 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e73c4085e00c4c8393e6fce2228b8421 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e73c4085e00c4c8393e6fce2228b8421 2023-10-29 23:53:39,002 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/f88f164d3c7940729e10d39cc12ae54b 2023-10-29 23:53:39,008 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/f88f164d3c7940729e10d39cc12ae54b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/f88f164d3c7940729e10d39cc12ae54b 2023-10-29 23:53:39,014 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/f88f164d3c7940729e10d39cc12ae54b, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 23:53:39,015 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 454ms, sequenceid=21, compaction requested=true 2023-10-29 23:53:39,015 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:39,015 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:39,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:39,017 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,017 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:39,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:39,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:39,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9c08c5[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:39,019 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:39,019 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,020 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,020 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:39,020 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:39,020 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:39,020 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,020 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:39,022 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:39,022 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,022 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,022 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:39,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:39,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:39,026 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:39,026 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:39,026 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:39,026 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,026 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:39,036 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,036 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:39,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,037 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:39,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:39,037 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,038 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,041 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:39,041 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:39,041 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,041 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:39,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:53:39,041 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:39,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:39,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:39,041 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:39,042 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,042 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,042 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,042 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,042 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:39,043 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:39,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:39,143 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:39,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:39,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:39,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:39,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,156 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:39,156 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:39,157 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:39,157 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:39,158 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,158 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,160 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,160 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:39,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:39,160 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,160 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,162 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,162 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:39,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:39,162 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:39,162 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:39,163 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:39,163 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:39,163 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:39,163 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:39,163 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:39,163 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:39,507 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:53:39,579 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123143b3bffd9a984e00a99ad58a6d119676 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123143b3bffd9a984e00a99ad58a6d119676 2023-10-29 23:53:39,985 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/c56edc69193045c8bc98e2242ac1d82f 2023-10-29 23:53:39,992 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/c56edc69193045c8bc98e2242ac1d82f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/c56edc69193045c8bc98e2242ac1d82f 2023-10-29 23:53:39,997 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/c56edc69193045c8bc98e2242ac1d82f, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 23:53:39,998 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 835ms, sequenceid=25, compaction requested=true 2023-10-29 23:53:39,998 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:39,998 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:40,001 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,001 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:40,001 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,001 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:40,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:40,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:40,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eba6e2c[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:40,003 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:40,003 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,004 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,004 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:40,004 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:40,004 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:40,004 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,004 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:40,005 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:40,005 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:40,005 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,006 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:40,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:40,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:40,008 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:40,009 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:40,009 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:40,009 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,009 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:40,010 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,010 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:40,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,010 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:40,011 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,012 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,015 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,015 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:40,015 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:40,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:53:40,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:40,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:40,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:40,015 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,015 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:40,015 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:40,016 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,016 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,016 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,016 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:40,016 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:40,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:40,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:40,116 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:40,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:40,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:40,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:40,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,125 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:40,125 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:40,125 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:40,125 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:40,126 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,126 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,127 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:40,127 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:40,128 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,128 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:40,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:40,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:40,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:40,129 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:40,130 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:40,130 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:40,130 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:40,130 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:40,130 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:40,547 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010629b3ca31bf47aba107464b82fc14b9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601010629b3ca31bf47aba107464b82fc14b9 2023-10-29 23:53:40,954 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/a3fa05200b644bb88349a639aa7125f3 2023-10-29 23:53:40,959 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/a3fa05200b644bb88349a639aa7125f3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/a3fa05200b644bb88349a639aa7125f3 2023-10-29 23:53:40,964 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/a3fa05200b644bb88349a639aa7125f3, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 23:53:40,965 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 835ms, sequenceid=29, compaction requested=true 2023-10-29 23:53:40,965 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:40,965 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:40,965 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:40,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:40,967 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,967 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,968 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:40,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:40,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@629b3c47[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:40,969 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:40,969 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,970 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:40,971 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,971 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:40,971 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:40,973 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:40,973 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,973 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:40,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:40,973 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:40,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:40,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:40,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:40,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:40,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:40,976 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:40,976 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:40,976 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:40,976 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,976 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:40,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:40,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,978 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:40,978 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:40,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,979 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:40,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,981 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,981 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,981 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,981 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:40,982 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:40,982 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:40,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:40,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:40,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:40,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:40,982 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:40,982 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,982 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,982 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:40,983 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:40,983 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:40,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:41,083 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:41,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:41,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:41,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:41,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,094 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:41,094 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:41,094 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:41,094 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:41,095 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,095 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,096 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,096 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:41,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:41,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:41,096 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,096 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:41,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:41,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,097 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,097 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:41,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,097 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:41,097 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:41,098 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:41,098 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:41,098 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:41,098 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:41,514 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b09106d739c643b584daeed2ec86131d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b09106d739c643b584daeed2ec86131d 2023-10-29 23:53:41,925 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/fe36779a679146548beba67df80d2af2 2023-10-29 23:53:41,936 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/fe36779a679146548beba67df80d2af2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/fe36779a679146548beba67df80d2af2 2023-10-29 23:53:41,943 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/fe36779a679146548beba67df80d2af2, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 23:53:41,944 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 846ms, sequenceid=33, compaction requested=true 2023-10-29 23:53:41,944 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:41,944 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:41,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:41,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:41,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:41,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:41,975 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,975 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:41,976 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,976 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:41,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:41,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:41,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@edb200c[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:41,977 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:41,977 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,983 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:41,983 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,983 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:41,996 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:41,996 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,996 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:41,996 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:41,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:41,999 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:41,999 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:41,999 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:41,999 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:41,999 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:42,001 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,001 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:42,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,001 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:42,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:42,002 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,003 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,006 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:42,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:53:42,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:42,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,006 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:42,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:42,007 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:42,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:42,007 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:42,108 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:42,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:42,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:42,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:42,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,118 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:42,118 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:42,118 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:42,118 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:42,119 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,119 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,120 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:42,120 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:42,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:42,120 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,120 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:42,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,121 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,121 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:42,121 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,121 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:42,121 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:42,122 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:42,122 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:42,122 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:42,122 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:42,122 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:42,122 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:42,537 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077aed329b6249446388aedb2d3b4d97f6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509077aed329b6249446388aedb2d3b4d97f6 2023-10-29 23:53:42,943 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/d0d2fd50a098433086eba8dd220f91e2 2023-10-29 23:53:42,949 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/d0d2fd50a098433086eba8dd220f91e2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d0d2fd50a098433086eba8dd220f91e2 2023-10-29 23:53:42,957 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d0d2fd50a098433086eba8dd220f91e2, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 23:53:42,958 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 836ms, sequenceid=37, compaction requested=true 2023-10-29 23:53:42,958 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:42,958 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:42,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:42,974 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,974 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:42,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:42,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:42,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:42,975 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,975 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:42,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707fdb32[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:42,976 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:42,976 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,978 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:42,978 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,979 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:42,980 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:42,980 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:42,980 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,980 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:42,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:42,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:42,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:42,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:42,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:42,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:42,985 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:42,985 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:42,985 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:42,985 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,985 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:42,987 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,987 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:42,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:42,987 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:42,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:42,988 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:42,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,989 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:42,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,992 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:42,992 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:42,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:42,992 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,992 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,992 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,992 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:42,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:42,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:42,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:42,992 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:42,993 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,993 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,993 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:42,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:53:42,994 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:42,994 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:43,094 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:43,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:43,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:43,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:43,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,102 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:43,102 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:43,103 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:53:43,103 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:43,103 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,104 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,105 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:43,105 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:43,105 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,105 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,106 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:53:43,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,106 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:53:43,106 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:43,107 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:53:43,108 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:43,108 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:43,108 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:43,108 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. started... 2023-10-29 23:53:43,108 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bb493c0b10ea913a02a3d41519407ba4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:43,525 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120919afcb10ed24775ab499a7107da386f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120919afcb10ed24775ab499a7107da386f 2023-10-29 23:53:43,931 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/1024d38fabca411bb9be0a49d4560bb1 2023-10-29 23:53:43,937 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/1024d38fabca411bb9be0a49d4560bb1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/1024d38fabca411bb9be0a49d4560bb1 2023-10-29 23:53:43,943 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/1024d38fabca411bb9be0a49d4560bb1, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 23:53:43,944 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bb493c0b10ea913a02a3d41519407ba4 in 836ms, sequenceid=41, compaction requested=true 2023-10-29 23:53:43,944 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:43,944 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:43,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:43,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:43,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:53:43,944 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:53:43,946 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,946 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:43,946 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,946 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:43,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d69101f[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:43,948 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:43,948 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,949 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:53:43,949 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:43,949 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,949 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:43,950 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,950 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:53:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:43,951 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:43,951 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:53:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:43,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:43,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:43,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:43,954 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:53:43,954 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:43,954 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:43,954 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,954 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:43,956 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,956 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:43,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:43,956 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:43,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:43,957 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,958 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,960 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,960 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:43,960 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,960 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:43,960 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:43,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:53:43,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 23:53:43,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:43,960 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:43,962 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:43,962 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,962 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,962 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:43,962 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:43,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:43,962 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:44,062 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:44,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:44,065 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-10-29 23:53:44,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:53:44,067 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:53:44,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:44,068 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624224068 2023-10-29 23:53:44,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:53:44,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-29 23:53:44,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:44,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x37d6d5c5 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:44,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@592d8fc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:44,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:44,909 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f60e2ab738634bcca53ebd9eb53d15ec to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f60e2ab738634bcca53ebd9eb53d15ec 2023-10-29 23:53:44,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:44,923 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:53:44,925 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:53:44,932 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:53:44,933 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:53:44,944 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/554a248b133044cfa3893fc58e3f3966 first=Optional[r5] last=Optional[r6] 2023-10-29 23:53:44,945 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/554a248b133044cfa3893fc58e3f3966}] 2023-10-29 23:53:44,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/554a248b133044cfa3893fc58e3f3966 for inclusion in bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:44,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-29 23:53:44,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:44,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:44,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/554a248b133044cfa3893fc58e3f3966 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lng5vo403d43de34nfnlmg6g1ub3cnr5egq99fl5qf2196v5i8244593g83sqlvv/family1/554a248b133044cfa3893fc58e3f3966 2023-10-29 23:53:44,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lng5vo403d43de34nfnlmg6g1ub3cnr5egq99fl5qf2196v5i8244593g83sqlvv/family1/554a248b133044cfa3893fc58e3f3966 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_ 2023-10-29 23:53:44,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lng5vo403d43de34nfnlmg6g1ub3cnr5egq99fl5qf2196v5i8244593g83sqlvv/family1/554a248b133044cfa3893fc58e3f3966 into bb493c0b10ea913a02a3d41519407ba4/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_ - updating store file list. 2023-10-29 23:53:44,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_ into bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:44,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lng5vo403d43de34nfnlmg6g1ub3cnr5egq99fl5qf2196v5i8244593g83sqlvv/family1/554a248b133044cfa3893fc58e3f3966 into bb493c0b10ea913a02a3d41519407ba4/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_) 2023-10-29 23:53:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__lng5vo403d43de34nfnlmg6g1ub3cnr5egq99fl5qf2196v5i8244593g83sqlvv/family1/554a248b133044cfa3893fc58e3f3966 2023-10-29 23:53:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 23:53:44,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 23:53:44,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): bb493c0b10ea913a02a3d41519407ba4/family1 is initiating minor compaction 2023-10-29 23:53:44,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f0231a3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:44,966 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bb493c0b10ea913a02a3d41519407ba4/family1 in testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:44,966 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/223a24309d5642f1882d1a1485f9a7f8, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/864c200b35cf425e9036d411609ff45f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/850d4bd7d2f74ef38348476c1d0cd9de, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/f88f164d3c7940729e10d39cc12ae54b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/c56edc69193045c8bc98e2242ac1d82f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/a3fa05200b644bb88349a639aa7125f3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/fe36779a679146548beba67df80d2af2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d0d2fd50a098433086eba8dd220f91e2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/1024d38fabca411bb9be0a49d4560bb1, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp, totalSize=49.7 K 2023-10-29 23:53:44,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 223a24309d5642f1882d1a1485f9a7f8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:53:44,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 864c200b35cf425e9036d411609ff45f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:53:44,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 850d4bd7d2f74ef38348476c1d0cd9de, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 23:53:44,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting f88f164d3c7940729e10d39cc12ae54b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 23:53:44,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting c56edc69193045c8bc98e2242ac1d82f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 23:53:44,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting a3fa05200b644bb88349a639aa7125f3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 23:53:44,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fe36779a679146548beba67df80d2af2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 23:53:44,967 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d0d2fd50a098433086eba8dd220f91e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 23:53:44,967 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1024d38fabca411bb9be0a49d4560bb1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 23:53:44,967 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 23:53:44,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:44,969 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:44,971 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601010629b3ca31bf47aba107464b82fc14b9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601010629b3ca31bf47aba107464b82fc14b9 2023-10-29 23:53:44,972 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b09106d739c643b584daeed2ec86131d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b09106d739c643b584daeed2ec86131d 2023-10-29 23:53:44,972 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-29 23:53:44,972 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-29 23:53:44,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:44,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:45,011 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): bb493c0b10ea913a02a3d41519407ba4#family1#compaction#22 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:53:45,052 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/0716710e53b24d48b3148603957b7a02 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/0716710e53b24d48b3148603957b7a02 2023-10-29 23:53:45,053 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231728efb5f2336407e929f50a1a54290de to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231728efb5f2336407e929f50a1a54290de 2023-10-29 23:53:45,054 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:45,059 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in bb493c0b10ea913a02a3d41519407ba4/family1 of bb493c0b10ea913a02a3d41519407ba4 into 0716710e53b24d48b3148603957b7a02(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:53:45,059 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:45,059 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698623624965; duration=0sec 2023-10-29 23:53:45,059 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:45,080 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f5ca3bf57e407d9abe76390eeb2fd5 first=Optional[r1] last=Optional[r4] 2023-10-29 23:53:45,081 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f5ca3bf57e407d9abe76390eeb2fd5}] 2023-10-29 23:53:45,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f5ca3bf57e407d9abe76390eeb2fd5 for inclusion in bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:45,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-29 23:53:45,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:45,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:45,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f5ca3bf57e407d9abe76390eeb2fd5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__78juq569nvoq47ldcbjmj4pvrhg2q2v7u1rnens89otuhai6bjqe2d5mv0pua4d8/family1/06f5ca3bf57e407d9abe76390eeb2fd5 2023-10-29 23:53:45,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__78juq569nvoq47ldcbjmj4pvrhg2q2v7u1rnens89otuhai6bjqe2d5mv0pua4d8/family1/06f5ca3bf57e407d9abe76390eeb2fd5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_ 2023-10-29 23:53:45,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__78juq569nvoq47ldcbjmj4pvrhg2q2v7u1rnens89otuhai6bjqe2d5mv0pua4d8/family1/06f5ca3bf57e407d9abe76390eeb2fd5 into bb493c0b10ea913a02a3d41519407ba4/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_ - updating store file list. 2023-10-29 23:53:45,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_ into bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:45,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__78juq569nvoq47ldcbjmj4pvrhg2q2v7u1rnens89otuhai6bjqe2d5mv0pua4d8/family1/06f5ca3bf57e407d9abe76390eeb2fd5 into bb493c0b10ea913a02a3d41519407ba4/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_) 2023-10-29 23:53:45,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__78juq569nvoq47ldcbjmj4pvrhg2q2v7u1rnens89otuhai6bjqe2d5mv0pua4d8/family1/06f5ca3bf57e407d9abe76390eeb2fd5 2023-10-29 23:53:45,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 23:53:45,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 23:53:45,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): bb493c0b10ea913a02a3d41519407ba4/family1 is initiating minor compaction (all files) 2023-10-29 23:53:45,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6db96080; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:45,096 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bb493c0b10ea913a02a3d41519407ba4/family1 in testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:53:45,097 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ab9fd65afdd14b2da1990e1b05dbf018, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/0716710e53b24d48b3148603957b7a02, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp, totalSize=178.1 K 2023-10-29 23:53:45,097 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting ab9fd65afdd14b2da1990e1b05dbf018, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823369 2023-10-29 23:53:45,098 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 0716710e53b24d48b3148603957b7a02, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223369 2023-10-29 23:53:45,098 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223369 2023-10-29 23:53:45,098 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:45,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:45,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a784c779622f4234b00b6128ff337680 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a784c779622f4234b00b6128ff337680 2023-10-29 23:53:45,102 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120549b7597e539f45418dcbb4112644ef82 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120549b7597e539f45418dcbb4112644ef82 2023-10-29 23:53:45,103 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e73c4085e00c4c8393e6fce2228b8421 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e73c4085e00c4c8393e6fce2228b8421 2023-10-29 23:53:45,105 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123143b3bffd9a984e00a99ad58a6d119676 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123143b3bffd9a984e00a99ad58a6d119676 2023-10-29 23:53:45,105 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-29 23:53:45,105 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-29 23:53:45,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:45,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:45,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/223a24309d5642f1882d1a1485f9a7f8, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/864c200b35cf425e9036d411609ff45f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/850d4bd7d2f74ef38348476c1d0cd9de, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/f88f164d3c7940729e10d39cc12ae54b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/c56edc69193045c8bc98e2242ac1d82f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/a3fa05200b644bb88349a639aa7125f3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/fe36779a679146548beba67df80d2af2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d0d2fd50a098433086eba8dd220f91e2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/1024d38fabca411bb9be0a49d4560bb1, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_] to archive 2023-10-29 23:53:45,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:45,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/223a24309d5642f1882d1a1485f9a7f8 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/223a24309d5642f1882d1a1485f9a7f8 2023-10-29 23:53:45,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/864c200b35cf425e9036d411609ff45f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/864c200b35cf425e9036d411609ff45f 2023-10-29 23:53:45,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/850d4bd7d2f74ef38348476c1d0cd9de to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/850d4bd7d2f74ef38348476c1d0cd9de 2023-10-29 23:53:45,124 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): bb493c0b10ea913a02a3d41519407ba4#family1#compaction#23 average throughput is 9.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:53:45,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/f88f164d3c7940729e10d39cc12ae54b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/f88f164d3c7940729e10d39cc12ae54b 2023-10-29 23:53:45,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/c56edc69193045c8bc98e2242ac1d82f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/c56edc69193045c8bc98e2242ac1d82f 2023-10-29 23:53:45,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/a3fa05200b644bb88349a639aa7125f3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/a3fa05200b644bb88349a639aa7125f3 2023-10-29 23:53:45,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/fe36779a679146548beba67df80d2af2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/fe36779a679146548beba67df80d2af2 2023-10-29 23:53:45,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d0d2fd50a098433086eba8dd220f91e2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d0d2fd50a098433086eba8dd220f91e2 2023-10-29 23:53:45,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/1024d38fabca411bb9be0a49d4560bb1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/1024d38fabca411bb9be0a49d4560bb1 2023-10-29 23:53:45,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/d26cf4220bbf457d9e46d4d3ad623e53_SeqId_44_ 2023-10-29 23:53:45,171 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300cef5c9a15cb4f2a84e040ea96db9fae to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300cef5c9a15cb4f2a84e040ea96db9fae 2023-10-29 23:53:45,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:45,200 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/99c78e278ae1492580e92c76c0818178 first=Optional[r00] last=Optional[r8] 2023-10-29 23:53:45,201 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/99c78e278ae1492580e92c76c0818178}] 2023-10-29 23:53:45,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/99c78e278ae1492580e92c76c0818178 for inclusion in bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:45,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-29 23:53:45,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:45,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:45,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/99c78e278ae1492580e92c76c0818178 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gjfgm1u597rbujh0d5de3rr18d88m50fbh8nmub849on7g01ultjt16k9r01f8s1/family1/99c78e278ae1492580e92c76c0818178 2023-10-29 23:53:45,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gjfgm1u597rbujh0d5de3rr18d88m50fbh8nmub849on7g01ultjt16k9r01f8s1/family1/99c78e278ae1492580e92c76c0818178 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ec7729caed86462cbf8417cfc244ece0_SeqId_49_ 2023-10-29 23:53:45,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gjfgm1u597rbujh0d5de3rr18d88m50fbh8nmub849on7g01ultjt16k9r01f8s1/family1/99c78e278ae1492580e92c76c0818178 into bb493c0b10ea913a02a3d41519407ba4/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ec7729caed86462cbf8417cfc244ece0_SeqId_49_ - updating store file list. 2023-10-29 23:53:45,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ec7729caed86462cbf8417cfc244ece0_SeqId_49_ into bb493c0b10ea913a02a3d41519407ba4/family1 2023-10-29 23:53:45,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gjfgm1u597rbujh0d5de3rr18d88m50fbh8nmub849on7g01ultjt16k9r01f8s1/family1/99c78e278ae1492580e92c76c0818178 into bb493c0b10ea913a02a3d41519407ba4/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ec7729caed86462cbf8417cfc244ece0_SeqId_49_) 2023-10-29 23:53:45,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithMonthlyPolicy__gjfgm1u597rbujh0d5de3rr18d88m50fbh8nmub849on7g01ultjt16k9r01f8s1/family1/99c78e278ae1492580e92c76c0818178 2023-10-29 23:53:45,217 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:45,218 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:45,220 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120919afcb10ed24775ab499a7107da386f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120919afcb10ed24775ab499a7107da386f 2023-10-29 23:53:45,221 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285b7b19fd3d544171828c5fef0dc221b4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511285b7b19fd3d544171828c5fef0dc221b4 2023-10-29 23:53:45,222 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113037fc21b8ec35481cb90012f0cc6a526a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113037fc21b8ec35481cb90012f0cc6a526a 2023-10-29 23:53:45,222 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-29 23:53:45,222 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 23:53:45,223 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:45,223 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:45,223 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:53:45,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:53:45,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:45,224 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:53:45,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.1590 sec 2023-10-29 23:53:45,331 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=263 (was 252) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53398 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53272 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53504 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d337c557df3246c99bd0f30aba043c2c java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53302 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x37d6d5c5-SendThread(127.0.0.1:50259) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53406 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53400 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d487384-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53382 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_353601910_17 at /127.0.0.1:53484 [Receiving block BP-697677233-172.31.14.131-1698623595371:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:34198 [Waiting for operation #37] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53428 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53332 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d487384-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53342 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53396 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d487384-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53434 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53376 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d487384-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53368 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1548678869_17 at /127.0.0.1:53336 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d487384-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1d487384-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x37d6d5c5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1005785718.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/514dde0830c04d4682235d5d12db400e block BP-697677233-172.31.14.131-1698623595371:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x1d487384-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_353601910_17 at /127.0.0.1:53498 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-697677233-172.31.14.131-1698623595371:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hconnection-0x73984eae-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50259@0x37d6d5c5-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: PacketResponder: BP-697677233-172.31.14.131-1698623595371:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=617 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 275) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=14660 (was 14863) 2023-10-29 23:53:45,342 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=263, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=169, AvailableMemoryMB=14659 2023-10-29 23:53:45,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 23:53:45,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:45,346 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:53:45,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-10-29 23:53:45,347 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:53:45,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 23:53:45,349 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:45,349 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a empty. 2023-10-29 23:53:45,350 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:45,350 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-10-29 23:53:45,359 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:45,360 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => bde89851cefe798361b48e9f1ef1975a, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:53:45,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 23:53:45,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 23:53:45,768 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:45,768 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing bde89851cefe798361b48e9f1ef1975a, disabling compactions & flushes 2023-10-29 23:53:45,768 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:45,768 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:45,768 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. after waiting 0 ms 2023-10-29 23:53:45,768 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:45,768 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:45,768 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:45,771 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:53:45,772 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698623625771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623625771"}]},"ts":"1698623625771"} 2023-10-29 23:53:45,773 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:53:45,774 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:53:45,775 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623625774"}]},"ts":"1698623625774"} 2023-10-29 23:53:45,776 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-29 23:53:45,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bde89851cefe798361b48e9f1ef1975a, ASSIGN}] 2023-10-29 23:53:45,784 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bde89851cefe798361b48e9f1ef1975a, ASSIGN 2023-10-29 23:53:45,785 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bde89851cefe798361b48e9f1ef1975a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:53:45,936 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=bde89851cefe798361b48e9f1ef1975a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:45,936 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698623625935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623625935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623625935"}]},"ts":"1698623625935"} 2023-10-29 23:53:45,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure bde89851cefe798361b48e9f1ef1975a, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:45,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 23:53:45,959 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/.tmp/family1/514dde0830c04d4682235d5d12db400e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/514dde0830c04d4682235d5d12db400e 2023-10-29 23:53:45,965 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in bb493c0b10ea913a02a3d41519407ba4/family1 of bb493c0b10ea913a02a3d41519407ba4 into 514dde0830c04d4682235d5d12db400e(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:53:45,965 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:53:45,966 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698623625096; duration=0sec 2023-10-29 23:53:45,966 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:46,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ab9fd65afdd14b2da1990e1b05dbf018, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/0716710e53b24d48b3148603957b7a02, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_] to archive 2023-10-29 23:53:46,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:46,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ab9fd65afdd14b2da1990e1b05dbf018 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/ab9fd65afdd14b2da1990e1b05dbf018 2023-10-29 23:53:46,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/0716710e53b24d48b3148603957b7a02 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/0716710e53b24d48b3148603957b7a02 2023-10-29 23:53:46,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/family1/2cbf5be0070a46b68ddfe4434247be6b_SeqId_47_ 2023-10-29 23:53:46,090 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:46,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:46,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bde89851cefe798361b48e9f1ef1975a, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:53:46,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:46,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:46,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:46,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:46,096 INFO [StoreOpener-bde89851cefe798361b48e9f1ef1975a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:46,098 DEBUG [StoreOpener-bde89851cefe798361b48e9f1ef1975a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1 2023-10-29 23:53:46,098 DEBUG [StoreOpener-bde89851cefe798361b48e9f1ef1975a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1 2023-10-29 23:53:46,098 INFO [StoreOpener-bde89851cefe798361b48e9f1ef1975a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bde89851cefe798361b48e9f1ef1975a columnFamilyName family1 2023-10-29 23:53:46,100 INFO [StoreOpener-bde89851cefe798361b48e9f1ef1975a-1] regionserver.HStore(310): Store=bde89851cefe798361b48e9f1ef1975a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:46,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:46,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:46,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:53:46,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:46,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bde89851cefe798361b48e9f1ef1975a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63882501, jitterRate=-0.048076555132865906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:53:46,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:46,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a., pid=25, masterSystemTime=1698623626090 2023-10-29 23:53:46,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:46,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:46,111 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=bde89851cefe798361b48e9f1ef1975a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:46,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698623626111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623626111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623626111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623626111"}]},"ts":"1698623626111"} 2023-10-29 23:53:46,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-10-29 23:53:46,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure bde89851cefe798361b48e9f1ef1975a, server=jenkins-hbase4.apache.org,40533,1698623599827 in 175 msec 2023-10-29 23:53:46,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-29 23:53:46,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=bde89851cefe798361b48e9f1ef1975a, ASSIGN in 332 msec 2023-10-29 23:53:46,121 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:53:46,121 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623626121"}]},"ts":"1698623626121"} 2023-10-29 23:53:46,123 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-29 23:53:46,125 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:53:46,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 781 msec 2023-10-29 23:53:46,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 23:53:46,452 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-10-29 23:53:46,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:46,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,476 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:46,476 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:46,476 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:46,476 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:46,477 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,477 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,478 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:46,478 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:46,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:46,479 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:46,479 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,479 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:46,480 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:46,480 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:46,480 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:46,481 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 23:53:46,905 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304a873d4091504e29a7193b1aa8ed087d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511304a873d4091504e29a7193b1aa8ed087d 2023-10-29 23:53:47,310 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/a9032d3439574763ba067a0525984664 2023-10-29 23:53:47,316 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/a9032d3439574763ba067a0525984664 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/a9032d3439574763ba067a0525984664 2023-10-29 23:53:47,321 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/a9032d3439574763ba067a0525984664, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-29 23:53:47,322 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 841ms, sequenceid=5, compaction requested=false 2023-10-29 23:53:47,322 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:47,323 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:47,323 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:47,323 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:47,323 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:47,323 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,323 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:47,323 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:47,324 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,324 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:47,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:47,325 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,325 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:47,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:47,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:47,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:47,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:47,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16ab78f1[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:47,326 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:47,326 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,327 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:47,328 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:47,328 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,328 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:47,329 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,329 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:47,329 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:47,329 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:47,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:47,331 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:47,331 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:47,331 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:47,331 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,331 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:47,334 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,334 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:47,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,334 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:47,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:47,334 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,335 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,337 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,337 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,337 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,337 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,337 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:47,338 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:47,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:47,338 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,338 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:47,338 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:47,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:47,338 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:47,338 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:47,338 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:47,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:47,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:47,438 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:47,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:47,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:47,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:47,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,446 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:47,446 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:47,446 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:47,446 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:47,446 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,446 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,447 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:47,447 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:47,448 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,448 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:47,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:47,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:47,449 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:47,449 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:47,449 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 23:53:47,864 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fb6c11984ddd4ee2a6c1800714efd798 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128fb6c11984ddd4ee2a6c1800714efd798 2023-10-29 23:53:48,269 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/d9f17ddc47ff4cdfbd5945325ea5cedb 2023-10-29 23:53:48,275 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/d9f17ddc47ff4cdfbd5945325ea5cedb as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/d9f17ddc47ff4cdfbd5945325ea5cedb 2023-10-29 23:53:48,280 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/d9f17ddc47ff4cdfbd5945325ea5cedb, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 23:53:48,281 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 832ms, sequenceid=9, compaction requested=false 2023-10-29 23:53:48,281 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:48,281 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:48,282 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:48,282 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:48,282 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,282 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:48,282 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:48,283 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,283 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:48,284 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,284 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:48,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:48,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41a7e168[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:48,285 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:48,286 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,287 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,288 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:48,288 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:48,288 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,288 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:48,288 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:48,289 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,289 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:48,289 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:48,289 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:48,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:48,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:48,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:48,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:48,291 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:48,292 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:48,292 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:48,292 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,292 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:48,293 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,293 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:48,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,293 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:48,294 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:48,295 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:48,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,297 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,297 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:48,297 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:48,297 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:48,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:48,297 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:48,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:48,297 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:48,297 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:48,298 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:48,298 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:48,298 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,298 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,298 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:48,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:48,398 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:48,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:48,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:48,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:48,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,406 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:48,406 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:48,406 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:48,406 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:48,406 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,406 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,413 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:48,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:48,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:48,413 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:48,413 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:48,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:48,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,414 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,414 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:48,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:48,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:48,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:48,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:48,415 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:48,415 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:48,415 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:48,833 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120148faa77844cf4b34a9a48e81197b2b52 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120148faa77844cf4b34a9a48e81197b2b52 2023-10-29 23:53:49,239 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/fe7379f752d843a480da051bef741e41 2023-10-29 23:53:49,245 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/fe7379f752d843a480da051bef741e41 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fe7379f752d843a480da051bef741e41 2023-10-29 23:53:49,250 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fe7379f752d843a480da051bef741e41, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 23:53:49,250 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 835ms, sequenceid=13, compaction requested=true 2023-10-29 23:53:49,251 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:49,251 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:49,251 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:49,252 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,252 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:49,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:49,253 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,253 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:49,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:49,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f8f1425[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:49,254 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:49,254 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,255 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:49,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:49,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:49,255 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,255 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:49,256 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:49,256 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,256 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:49,257 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:49,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:49,259 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:49,259 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:49,259 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:49,259 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,259 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:49,262 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,262 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:49,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,262 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:49,262 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:49,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,263 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,270 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,270 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,270 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:49,270 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:49,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:49,270 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:49,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:49,270 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:49,270 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:49,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:49,271 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:49,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:49,271 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:49,271 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:49,271 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,271 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,371 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:49,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:49,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:49,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:49,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,379 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:49,379 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:49,379 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:49,379 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:49,379 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,379 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,380 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,380 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:49,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:49,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:49,381 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:49,381 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:49,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,382 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,382 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:49,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:49,382 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:49,382 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:49,382 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:49,796 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205121048dcc3604719b105352cc4e5394f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205121048dcc3604719b105352cc4e5394f 2023-10-29 23:53:50,202 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/c330ed99b786455da757349417fd274e 2023-10-29 23:53:50,210 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/c330ed99b786455da757349417fd274e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/c330ed99b786455da757349417fd274e 2023-10-29 23:53:50,217 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/c330ed99b786455da757349417fd274e, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 23:53:50,218 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 836ms, sequenceid=17, compaction requested=true 2023-10-29 23:53:50,218 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:50,218 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:50,220 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:50,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:50,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a831c23[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:50,222 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:50,223 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,224 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:50,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:50,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:50,224 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,224 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:50,226 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:50,226 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,226 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:50,226 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:50,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:50,229 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:50,229 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:50,229 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:50,229 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,229 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:50,232 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,232 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:50,232 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:50,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:50,233 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,235 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:50,238 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:50,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:50,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:50,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:50,238 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:50,239 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:50,339 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:50,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:50,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:50,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:50,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,346 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:50,346 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:50,346 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:50,346 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:50,347 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,347 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,348 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,348 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:50,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:50,348 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:50,348 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:50,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,349 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,349 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:50,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:50,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:50,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:50,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:50,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:50,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:50,350 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:50,350 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:50,350 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:50,765 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283f086989b8cb4f7694153602186d7e70 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283f086989b8cb4f7694153602186d7e70 2023-10-29 23:53:51,171 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/87b9860682cf43a4af8776851e6ec4b4 2023-10-29 23:53:51,177 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/87b9860682cf43a4af8776851e6ec4b4 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/87b9860682cf43a4af8776851e6ec4b4 2023-10-29 23:53:51,183 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/87b9860682cf43a4af8776851e6ec4b4, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 23:53:51,184 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 834ms, sequenceid=21, compaction requested=true 2023-10-29 23:53:51,185 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:51,185 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:51,185 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:51,187 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,187 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:51,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:51,188 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,188 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:51,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:51,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:51,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:51,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:51,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67a29572[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:51,190 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:51,190 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,191 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:51,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:51,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:51,191 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,192 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:51,193 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:51,193 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:51,193 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:51,193 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:51,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:51,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:51,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:51,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:51,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:51,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:51,197 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:51,197 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:51,198 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:51,198 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,198 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:51,201 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,201 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:51,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,201 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:51,201 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:51,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:51,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:51,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:51,203 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:51,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:51,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:51,206 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:51,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:51,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:51,206 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:51,206 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:51,206 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:51,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:51,206 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,206 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,207 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:51,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:51,207 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:51,307 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:51,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:51,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:51,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:51,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,314 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:51,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:51,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:51,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:51,315 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,315 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,316 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:51,316 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:51,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:51,317 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:51,317 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:51,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:51,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:51,318 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:51,318 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:51,318 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:51,318 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:51,632 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:53:51,732 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312f1b7531f243442ba9b8bcad82e0bf68 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512312f1b7531f243442ba9b8bcad82e0bf68 2023-10-29 23:53:52,138 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/fb39b969e91a4748a1730ee23da5729a 2023-10-29 23:53:52,144 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/fb39b969e91a4748a1730ee23da5729a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fb39b969e91a4748a1730ee23da5729a 2023-10-29 23:53:52,149 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fb39b969e91a4748a1730ee23da5729a, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 23:53:52,150 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 832ms, sequenceid=25, compaction requested=true 2023-10-29 23:53:52,150 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:52,150 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:52,150 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:52,150 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:52,150 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,150 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:52,150 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:52,151 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,151 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:52,152 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,152 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:52,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:52,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:52,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f0844f[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:52,153 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:52,153 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,155 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:52,155 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:52,155 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:52,155 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,155 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:52,156 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:52,156 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,156 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:52,156 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:52,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:52,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:52,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:52,158 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:52,158 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:52,158 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:52,158 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,158 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:52,164 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,164 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:52,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,164 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:52,164 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,166 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,168 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,168 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:52,168 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:52,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:52,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:52,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:52,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:52,168 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:52,168 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,168 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:52,169 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,169 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:52,169 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,169 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:52,169 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,169 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:52,269 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:52,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:52,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:52,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:52,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,276 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:52,276 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:52,276 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:52,276 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:52,277 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,277 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,278 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,278 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:52,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:52,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:52,278 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:52,278 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:52,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:52,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,279 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,280 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:52,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:52,280 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:52,280 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:52,280 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:52,280 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:52,280 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:52,280 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:52,280 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:52,280 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:52,694 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ecc56f441c8743149b8c472da8feaa04 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101ecc56f441c8743149b8c472da8feaa04 2023-10-29 23:53:53,100 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/3dd0c219c4a046629ddc500ad51c9523 2023-10-29 23:53:53,106 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/3dd0c219c4a046629ddc500ad51c9523 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/3dd0c219c4a046629ddc500ad51c9523 2023-10-29 23:53:53,111 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/3dd0c219c4a046629ddc500ad51c9523, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 23:53:53,112 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 832ms, sequenceid=29, compaction requested=true 2023-10-29 23:53:53,112 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:53,112 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:53,115 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,115 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:53,115 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,115 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:53,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:53,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:53,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:53,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:53,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ee99568[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:53,117 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:53,117 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,119 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,119 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:53,119 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:53,119 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,119 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:53,119 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:53,120 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,120 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:53,120 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:53,120 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:53,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:53,123 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:53,123 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:53,123 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:53,123 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,123 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:53,124 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,124 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,125 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:53,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:53,125 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:53,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,126 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:53,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:53,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,130 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:53,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:53,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:53,130 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:53,231 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:53,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:53,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:53,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:53,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,238 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:53,238 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:53,238 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:53,238 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:53,238 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,239 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,240 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:53,240 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:53,240 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,240 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,241 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,241 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:53,241 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,241 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:53,241 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:53,241 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:53,242 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:53,242 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:53,242 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:53,242 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:53,242 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:53,655 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fe71c00de34244179c4a3df87518ad98 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fe71c00de34244179c4a3df87518ad98 2023-10-29 23:53:53,661 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/25064886f5f7484987a0119095106b3a 2023-10-29 23:53:53,666 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/25064886f5f7484987a0119095106b3a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/25064886f5f7484987a0119095106b3a 2023-10-29 23:53:53,670 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/25064886f5f7484987a0119095106b3a, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 23:53:53,671 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 429ms, sequenceid=33, compaction requested=true 2023-10-29 23:53:53,671 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:53,671 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:53,671 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:53,671 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:53,671 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,671 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:53,671 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:53,673 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,673 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:53,673 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,673 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:53,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:53,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c39f692[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:53,675 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:53,675 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,676 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,676 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:53,676 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:53,676 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:53,676 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,676 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:53,681 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,681 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:53,681 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:53,681 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:53,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:53,684 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:53,684 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:53,684 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:53,684 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,684 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:53,685 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,685 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:53,685 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,686 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:53,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:53,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:53,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:53,687 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:53,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:53,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,689 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:53,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:53,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:53,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:53,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:53,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:53,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:53,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:53,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,690 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,690 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,690 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:53,690 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:53,790 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:53,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:53,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:53,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:53,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,798 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:53,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:53,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:53,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:53,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,799 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:53,799 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:53,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:53,800 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:53,800 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:53,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,801 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,801 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:53,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:53,802 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:53,802 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:53,802 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:53,802 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:53,802 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:53,802 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:53,802 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:53,821 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074ec18bbcf6c74bb7b7c28de2d629cc53 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509074ec18bbcf6c74bb7b7c28de2d629cc53 2023-10-29 23:53:54,227 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/fef5329b97b84731aa85c6c19fdf66b4 2023-10-29 23:53:54,234 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/fef5329b97b84731aa85c6c19fdf66b4 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fef5329b97b84731aa85c6c19fdf66b4 2023-10-29 23:53:54,249 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fef5329b97b84731aa85c6c19fdf66b4, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 23:53:54,254 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 452ms, sequenceid=37, compaction requested=true 2023-10-29 23:53:54,254 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:54,254 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:54,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:54,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:54,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:54,255 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:54,258 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,258 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:54,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:54,259 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:54,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:54,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:54,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:54,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fc3e962[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:54,260 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:54,260 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,269 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,270 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:54,270 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:54,270 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:54,270 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,270 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:54,271 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,271 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:54,271 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:54,272 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:54,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:54,275 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:54,275 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:54,275 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:54,275 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,275 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:54,277 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,277 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:54,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,277 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:54,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:54,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:54,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:54,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:54,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,278 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,280 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:54,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,289 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,289 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:54,289 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,289 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:54,289 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:54,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:54,289 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:54,289 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:54,290 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:54,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:54,290 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,290 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:54,290 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:54,290 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,390 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:54,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:54,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:54,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,398 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:54,398 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:54,398 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:53:54,398 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:53:54,398 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,398 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,401 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:54,401 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:54,401 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,401 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:54,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,402 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:53:54,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,402 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:53:54,402 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:54,402 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:53:54,402 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:53:54,403 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:54,403 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:54,403 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. started... 2023-10-29 23:53:54,403 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bde89851cefe798361b48e9f1ef1975a 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:53:54,417 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207008501b18bf49ebb79fac5ba9023794 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511207008501b18bf49ebb79fac5ba9023794 2023-10-29 23:53:54,822 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/01b6dd187ff34089a036ee850d44d46f 2023-10-29 23:53:54,828 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/01b6dd187ff34089a036ee850d44d46f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/01b6dd187ff34089a036ee850d44d46f 2023-10-29 23:53:54,833 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/01b6dd187ff34089a036ee850d44d46f, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 23:53:54,834 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bde89851cefe798361b48e9f1ef1975a in 431ms, sequenceid=41, compaction requested=true 2023-10-29 23:53:54,834 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:54,834 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:54,834 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:53:54,835 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:53:54,835 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,835 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:53:54,835 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:53:54,836 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,836 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:54,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:54,836 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,837 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:54,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:53:54,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@728cca29[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:54,838 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:53:54,838 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,839 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:53:54,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:53:54,839 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,839 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:54,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:54,840 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:53:54,840 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,840 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:54,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:54,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:54,840 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:53:54,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:54,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:54,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:54,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:54,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:53:54,843 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:53:54,843 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:54,843 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:54,843 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,843 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:54,845 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,845 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:54,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,845 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,846 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:54,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:54,847 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:54,849 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:54,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 23:53:54,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:54,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:54,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,849 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:54,850 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:54,850 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,850 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,950 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:54,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:54,952 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-10-29 23:53:54,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:53:54,954 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:53:54,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:54,955 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624234955 2023-10-29 23:53:54,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 23:53:54,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-29 23:53:54,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:53:54,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x320123f9 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:53:54,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@767e9f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:53:54,963 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,804 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032c3719f878884bcd9e1054e0bc54e87c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601032c3719f878884bcd9e1054e0bc54e87c 2023-10-29 23:53:55,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:53:55,818 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:53:55,819 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:53:55,825 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:53:55,827 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:53:55,836 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26a8988f613746e38f3f17165d656a68 first=Optional[r3] last=Optional[r6] 2023-10-29 23:53:55,837 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26a8988f613746e38f3f17165d656a68}] 2023-10-29 23:53:55,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26a8988f613746e38f3f17165d656a68 for inclusion in bde89851cefe798361b48e9f1ef1975a/family1 2023-10-29 23:53:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 23:53:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:55,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:55,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/26a8988f613746e38f3f17165d656a68 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pfq59ohaf4iu3762aapi21j0t3rt13ics3ud7t59he32m9pk3li8vf7qarm3v2te/family1/26a8988f613746e38f3f17165d656a68 2023-10-29 23:53:55,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pfq59ohaf4iu3762aapi21j0t3rt13ics3ud7t59he32m9pk3li8vf7qarm3v2te/family1/26a8988f613746e38f3f17165d656a68 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_ 2023-10-29 23:53:55,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pfq59ohaf4iu3762aapi21j0t3rt13ics3ud7t59he32m9pk3li8vf7qarm3v2te/family1/26a8988f613746e38f3f17165d656a68 into bde89851cefe798361b48e9f1ef1975a/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_ - updating store file list. 2023-10-29 23:53:55,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_ into bde89851cefe798361b48e9f1ef1975a/family1 2023-10-29 23:53:55,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pfq59ohaf4iu3762aapi21j0t3rt13ics3ud7t59he32m9pk3li8vf7qarm3v2te/family1/26a8988f613746e38f3f17165d656a68 into bde89851cefe798361b48e9f1ef1975a/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_) 2023-10-29 23:53:55,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pfq59ohaf4iu3762aapi21j0t3rt13ics3ud7t59he32m9pk3li8vf7qarm3v2te/family1/26a8988f613746e38f3f17165d656a68 2023-10-29 23:53:55,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 23:53:55,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 23:53:55,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): bde89851cefe798361b48e9f1ef1975a/family1 is initiating minor compaction 2023-10-29 23:53:55,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@48ab8584; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:55,858 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bde89851cefe798361b48e9f1ef1975a/family1 in testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:53:55,858 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/d9f17ddc47ff4cdfbd5945325ea5cedb, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fe7379f752d843a480da051bef741e41, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/c330ed99b786455da757349417fd274e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/87b9860682cf43a4af8776851e6ec4b4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fb39b969e91a4748a1730ee23da5729a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/3dd0c219c4a046629ddc500ad51c9523, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/25064886f5f7484987a0119095106b3a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fef5329b97b84731aa85c6c19fdf66b4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/01b6dd187ff34089a036ee850d44d46f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp, totalSize=50.0 K 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d9f17ddc47ff4cdfbd5945325ea5cedb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fe7379f752d843a480da051bef741e41, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting c330ed99b786455da757349417fd274e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 87b9860682cf43a4af8776851e6ec4b4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fb39b969e91a4748a1730ee23da5729a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 3dd0c219c4a046629ddc500ad51c9523, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 25064886f5f7484987a0119095106b3a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fef5329b97b84731aa85c6c19fdf66b4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 01b6dd187ff34089a036ee850d44d46f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 23:53:55,858 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting b5219c2210cc428084926601f043eb55_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 23:53:55,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:53:55,861 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:55,863 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283f086989b8cb4f7694153602186d7e70 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283f086989b8cb4f7694153602186d7e70 2023-10-29 23:53:55,864 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512312f1b7531f243442ba9b8bcad82e0bf68 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512312f1b7531f243442ba9b8bcad82e0bf68 2023-10-29 23:53:55,866 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101ecc56f441c8743149b8c472da8feaa04 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101ecc56f441c8743149b8c472da8feaa04 2023-10-29 23:53:55,867 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fe71c00de34244179c4a3df87518ad98 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fe71c00de34244179c4a3df87518ad98 2023-10-29 23:53:55,867 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-29 23:53:55,867 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:55,894 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): bde89851cefe798361b48e9f1ef1975a#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:53:56,303 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120592e1185a72b24a56bf7e9ee0c0b1bcee to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120592e1185a72b24a56bf7e9ee0c0b1bcee 2023-10-29 23:53:56,305 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:53:56,332 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/307398264b3a4775abbbc54ffe848439 first=Optional[r1] last=Optional[r2] 2023-10-29 23:53:56,332 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/307398264b3a4775abbbc54ffe848439}] 2023-10-29 23:53:56,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/307398264b3a4775abbbc54ffe848439 for inclusion in bde89851cefe798361b48e9f1ef1975a/family1 2023-10-29 23:53:56,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-29 23:53:56,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:53:56,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:56,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/307398264b3a4775abbbc54ffe848439 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nki2q5s1u5g0eahsd8jtuoh7ftang46ea935042m7mm14bcpqv2e0gor98cgd7kd/family1/307398264b3a4775abbbc54ffe848439 2023-10-29 23:53:56,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nki2q5s1u5g0eahsd8jtuoh7ftang46ea935042m7mm14bcpqv2e0gor98cgd7kd/family1/307398264b3a4775abbbc54ffe848439 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/e67a399316444512b1abfb4ef69cb909_SeqId_46_ 2023-10-29 23:53:56,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nki2q5s1u5g0eahsd8jtuoh7ftang46ea935042m7mm14bcpqv2e0gor98cgd7kd/family1/307398264b3a4775abbbc54ffe848439 into bde89851cefe798361b48e9f1ef1975a/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/e67a399316444512b1abfb4ef69cb909_SeqId_46_ - updating store file list. 2023-10-29 23:53:56,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/e67a399316444512b1abfb4ef69cb909_SeqId_46_ into bde89851cefe798361b48e9f1ef1975a/family1 2023-10-29 23:53:56,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nki2q5s1u5g0eahsd8jtuoh7ftang46ea935042m7mm14bcpqv2e0gor98cgd7kd/family1/307398264b3a4775abbbc54ffe848439 into bde89851cefe798361b48e9f1ef1975a/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/e67a399316444512b1abfb4ef69cb909_SeqId_46_) 2023-10-29 23:53:56,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nki2q5s1u5g0eahsd8jtuoh7ftang46ea935042m7mm14bcpqv2e0gor98cgd7kd/family1/307398264b3a4775abbbc54ffe848439 2023-10-29 23:53:56,349 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:53:56,350 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:56,351 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120148faa77844cf4b34a9a48e81197b2b52 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120148faa77844cf4b34a9a48e81197b2b52 2023-10-29 23:53:56,352 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205121048dcc3604719b105352cc4e5394f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205121048dcc3604719b105352cc4e5394f 2023-10-29 23:53:56,352 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-10-29 23:53:56,352 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 23:53:56,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:53:56,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:53:56,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:53:56,354 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:53:56,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4010 sec 2023-10-29 23:53:56,469 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=261 (was 263), OpenFileDescriptor=629 (was 617) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 287), ProcessCount=169 (was 169), AvailableMemoryMB=14393 (was 14659) 2023-10-29 23:53:56,482 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=261, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=169, AvailableMemoryMB=14392 2023-10-29 23:53:56,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 23:53:56,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:56,487 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:53:56,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-10-29 23:53:56,488 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:53:56,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 23:53:56,490 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:56,490 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:56,490 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:56,491 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b empty. 2023-10-29 23:53:56,491 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505 empty. 2023-10-29 23:53:56,491 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46 empty. 2023-10-29 23:53:56,491 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:56,492 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:56,492 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:56,492 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-10-29 23:53:56,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 23:53:56,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/.tmp/family1/b28cd2b2ae40416f999019e23b36e29a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b28cd2b2ae40416f999019e23b36e29a 2023-10-29 23:53:56,720 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in bde89851cefe798361b48e9f1ef1975a/family1 of bde89851cefe798361b48e9f1ef1975a into b28cd2b2ae40416f999019e23b36e29a(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:53:56,720 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:53:56,720 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698623635857; duration=0sec 2023-10-29 23:53:56,720 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:53:56,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 23:53:56,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/d9f17ddc47ff4cdfbd5945325ea5cedb, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fe7379f752d843a480da051bef741e41, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/c330ed99b786455da757349417fd274e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/87b9860682cf43a4af8776851e6ec4b4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fb39b969e91a4748a1730ee23da5729a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/3dd0c219c4a046629ddc500ad51c9523, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/25064886f5f7484987a0119095106b3a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fef5329b97b84731aa85c6c19fdf66b4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/01b6dd187ff34089a036ee850d44d46f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_] to archive 2023-10-29 23:53:56,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:53:56,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/d9f17ddc47ff4cdfbd5945325ea5cedb to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/d9f17ddc47ff4cdfbd5945325ea5cedb 2023-10-29 23:53:56,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fe7379f752d843a480da051bef741e41 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fe7379f752d843a480da051bef741e41 2023-10-29 23:53:56,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/c330ed99b786455da757349417fd274e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/c330ed99b786455da757349417fd274e 2023-10-29 23:53:56,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/87b9860682cf43a4af8776851e6ec4b4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/87b9860682cf43a4af8776851e6ec4b4 2023-10-29 23:53:56,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fb39b969e91a4748a1730ee23da5729a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fb39b969e91a4748a1730ee23da5729a 2023-10-29 23:53:56,825 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/3dd0c219c4a046629ddc500ad51c9523 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/3dd0c219c4a046629ddc500ad51c9523 2023-10-29 23:53:56,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/25064886f5f7484987a0119095106b3a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/25064886f5f7484987a0119095106b3a 2023-10-29 23:53:56,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fef5329b97b84731aa85c6c19fdf66b4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/fef5329b97b84731aa85c6c19fdf66b4 2023-10-29 23:53:56,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/01b6dd187ff34089a036ee850d44d46f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/01b6dd187ff34089a036ee850d44d46f 2023-10-29 23:53:56,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/family1/b5219c2210cc428084926601f043eb55_SeqId_44_ 2023-10-29 23:53:56,901 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-10-29 23:53:56,902 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 368df6736c0a028a52e8a16a42f4459b, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:53:56,903 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => d5dabbd5b853e6e71a0d5e5a22a35e46, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:53:56,903 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1103e88b929851b6544b2e0f1f56c505, NAME => 'testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:53:56,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:56,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 1103e88b929851b6544b2e0f1f56c505, disabling compactions & flushes 2023-10-29 23:53:56,913 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:56,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:56,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. after waiting 0 ms 2023-10-29 23:53:56,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:56,913 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:56,913 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 1103e88b929851b6544b2e0f1f56c505: 2023-10-29 23:53:57,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 23:53:57,311 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:57,311 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing d5dabbd5b853e6e71a0d5e5a22a35e46, disabling compactions & flushes 2023-10-29 23:53:57,311 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:57,311 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:57,311 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. after waiting 0 ms 2023-10-29 23:53:57,311 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:57,311 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:57,311 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for d5dabbd5b853e6e71a0d5e5a22a35e46: 2023-10-29 23:53:57,314 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:57,314 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 368df6736c0a028a52e8a16a42f4459b, disabling compactions & flushes 2023-10-29 23:53:57,314 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:57,314 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:57,314 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. after waiting 0 ms 2023-10-29 23:53:57,314 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:57,314 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:57,314 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 368df6736c0a028a52e8a16a42f4459b: 2023-10-29 23:53:57,316 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:53:57,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698623637317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623637317"}]},"ts":"1698623637317"} 2023-10-29 23:53:57,318 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698623637317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623637317"}]},"ts":"1698623637317"} 2023-10-29 23:53:57,318 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698623637317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623637317"}]},"ts":"1698623637317"} 2023-10-29 23:53:57,320 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 23:53:57,321 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:53:57,321 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623637321"}]},"ts":"1698623637321"} 2023-10-29 23:53:57,323 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-10-29 23:53:57,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1103e88b929851b6544b2e0f1f56c505, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5dabbd5b853e6e71a0d5e5a22a35e46, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=368df6736c0a028a52e8a16a42f4459b, ASSIGN}] 2023-10-29 23:53:57,328 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1103e88b929851b6544b2e0f1f56c505, ASSIGN 2023-10-29 23:53:57,328 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5dabbd5b853e6e71a0d5e5a22a35e46, ASSIGN 2023-10-29 23:53:57,328 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=368df6736c0a028a52e8a16a42f4459b, ASSIGN 2023-10-29 23:53:57,329 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1103e88b929851b6544b2e0f1f56c505, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:53:57,329 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5dabbd5b853e6e71a0d5e5a22a35e46, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:53:57,329 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=368df6736c0a028a52e8a16a42f4459b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:53:57,481 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d5dabbd5b853e6e71a0d5e5a22a35e46, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:57,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=368df6736c0a028a52e8a16a42f4459b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:57,481 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698623637481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623637481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623637481"}]},"ts":"1698623637481"} 2023-10-29 23:53:57,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698623637481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623637481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623637481"}]},"ts":"1698623637481"} 2023-10-29 23:53:57,481 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1103e88b929851b6544b2e0f1f56c505, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:57,481 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698623637481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623637481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623637481"}]},"ts":"1698623637481"} 2023-10-29 23:53:57,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure d5dabbd5b853e6e71a0d5e5a22a35e46, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:57,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 368df6736c0a028a52e8a16a42f4459b, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:57,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 1103e88b929851b6544b2e0f1f56c505, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:53:57,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 23:53:57,636 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:57,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:57,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1103e88b929851b6544b2e0f1f56c505, NAME => 'testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 23:53:57,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:57,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,641 INFO [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,642 DEBUG [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505/family1 2023-10-29 23:53:57,642 DEBUG [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505/family1 2023-10-29 23:53:57,643 INFO [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1103e88b929851b6544b2e0f1f56c505 columnFamilyName family1 2023-10-29 23:53:57,645 INFO [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] regionserver.HStore(310): Store=1103e88b929851b6544b2e0f1f56c505/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:57,645 INFO [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,646 DEBUG [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505/family2 2023-10-29 23:53:57,646 DEBUG [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505/family2 2023-10-29 23:53:57,647 INFO [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1103e88b929851b6544b2e0f1f56c505 columnFamilyName family2 2023-10-29 23:53:57,648 INFO [StoreOpener-1103e88b929851b6544b2e0f1f56c505-1] regionserver.HStore(310): Store=1103e88b929851b6544b2e0f1f56c505/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:57,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:53:57,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:53:57,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:57,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1103e88b929851b6544b2e0f1f56c505; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73211294, jitterRate=0.09093329310417175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:53:57,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1103e88b929851b6544b2e0f1f56c505: 2023-10-29 23:53:57,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505., pid=33, masterSystemTime=1698623637636 2023-10-29 23:53:57,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:57,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:57,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:57,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 368df6736c0a028a52e8a16a42f4459b, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 23:53:57,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1103e88b929851b6544b2e0f1f56c505, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:57,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:57,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,658 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698623637658"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623637658"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623637658"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623637658"}]},"ts":"1698623637658"} 2023-10-29 23:53:57,659 INFO [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,661 DEBUG [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1 2023-10-29 23:53:57,661 DEBUG [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1 2023-10-29 23:53:57,661 INFO [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 368df6736c0a028a52e8a16a42f4459b columnFamilyName family1 2023-10-29 23:53:57,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=28 2023-10-29 23:53:57,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 1103e88b929851b6544b2e0f1f56c505, server=jenkins-hbase4.apache.org,40533,1698623599827 in 174 msec 2023-10-29 23:53:57,662 INFO [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] regionserver.HStore(310): Store=368df6736c0a028a52e8a16a42f4459b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:57,663 INFO [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=1103e88b929851b6544b2e0f1f56c505, ASSIGN in 336 msec 2023-10-29 23:53:57,664 DEBUG [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family2 2023-10-29 23:53:57,664 DEBUG [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family2 2023-10-29 23:53:57,665 INFO [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 368df6736c0a028a52e8a16a42f4459b columnFamilyName family2 2023-10-29 23:53:57,666 INFO [StoreOpener-368df6736c0a028a52e8a16a42f4459b-1] regionserver.HStore(310): Store=368df6736c0a028a52e8a16a42f4459b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:57,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,668 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-10-29 23:53:57,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:53:57,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:53:57,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:57,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 368df6736c0a028a52e8a16a42f4459b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67700932, jitterRate=0.008822500705718994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:53:57,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 368df6736c0a028a52e8a16a42f4459b: 2023-10-29 23:53:57,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b., pid=32, masterSystemTime=1698623637636 2023-10-29 23:53:57,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:57,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:57,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:57,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5dabbd5b853e6e71a0d5e5a22a35e46, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 23:53:57,675 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=368df6736c0a028a52e8a16a42f4459b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:57,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:53:57,676 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698623637675"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623637675"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623637675"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623637675"}]},"ts":"1698623637675"} 2023-10-29 23:53:57,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,677 INFO [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,678 DEBUG [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46/family1 2023-10-29 23:53:57,678 DEBUG [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46/family1 2023-10-29 23:53:57,679 INFO [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5dabbd5b853e6e71a0d5e5a22a35e46 columnFamilyName family1 2023-10-29 23:53:57,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-10-29 23:53:57,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 368df6736c0a028a52e8a16a42f4459b, server=jenkins-hbase4.apache.org,40533,1698623599827 in 193 msec 2023-10-29 23:53:57,680 INFO [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] regionserver.HStore(310): Store=d5dabbd5b853e6e71a0d5e5a22a35e46/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:57,680 INFO [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=368df6736c0a028a52e8a16a42f4459b, ASSIGN in 353 msec 2023-10-29 23:53:57,681 DEBUG [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46/family2 2023-10-29 23:53:57,681 DEBUG [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46/family2 2023-10-29 23:53:57,682 INFO [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5dabbd5b853e6e71a0d5e5a22a35e46 columnFamilyName family2 2023-10-29 23:53:57,682 INFO [StoreOpener-d5dabbd5b853e6e71a0d5e5a22a35e46-1] regionserver.HStore(310): Store=d5dabbd5b853e6e71a0d5e5a22a35e46/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:53:57,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:53:57,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:53:57,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:53:57,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5dabbd5b853e6e71a0d5e5a22a35e46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62274934, jitterRate=-0.072031170129776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:53:57,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5dabbd5b853e6e71a0d5e5a22a35e46: 2023-10-29 23:53:57,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46., pid=31, masterSystemTime=1698623637636 2023-10-29 23:53:57,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:57,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:57,690 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=d5dabbd5b853e6e71a0d5e5a22a35e46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:57,691 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698623637690"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623637690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623637690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623637690"}]},"ts":"1698623637690"} 2023-10-29 23:53:57,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-29 23:53:57,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure d5dabbd5b853e6e71a0d5e5a22a35e46, server=jenkins-hbase4.apache.org,40533,1698623599827 in 209 msec 2023-10-29 23:53:57,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-29 23:53:57,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=d5dabbd5b853e6e71a0d5e5a22a35e46, ASSIGN in 368 msec 2023-10-29 23:53:57,696 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:53:57,696 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623637696"}]},"ts":"1698623637696"} 2023-10-29 23:53:57,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-10-29 23:53:57,700 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:53:57,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2160 sec 2023-10-29 23:53:58,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 23:53:58,593 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-10-29 23:53:58,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:58,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,602 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-29 23:53:58,602 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:58,602 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-29 23:53:58,602 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-29 23:53:58,602 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,602 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,605 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:58,605 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:58,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:58,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:58,605 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:58,605 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-29 23:53:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-29 23:53:58,607 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:58,607 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. started... 2023-10-29 23:53:58,607 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:58,607 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. started... 2023-10-29 23:53:58,608 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 368df6736c0a028a52e8a16a42f4459b 2/2 column families, dataSize=48 B heapSize=632 B 2023-10-29 23:53:58,607 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:53:58,608 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d5dabbd5b853e6e71a0d5e5a22a35e46: 2023-10-29 23:53:58,608 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:58,608 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:58,608 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:58,608 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. started... 2023-10-29 23:53:58,608 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:53:58,609 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1103e88b929851b6544b2e0f1f56c505: 2023-10-29 23:53:58,609 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:58,609 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:53:59,022 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102970b606d4ce264e3aa91d907efe5bf8dd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023102970b606d4ce264e3aa91d907efe5bf8dd 2023-10-29 23:53:59,029 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/.tmp/family1/98ea8e7947df4da8baf6531232f9d5f4 2023-10-29 23:53:59,035 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/.tmp/family1/98ea8e7947df4da8baf6531232f9d5f4 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/98ea8e7947df4da8baf6531232f9d5f4 2023-10-29 23:53:59,040 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/98ea8e7947df4da8baf6531232f9d5f4, entries=1, sequenceid=5, filesize=4.9 K 2023-10-29 23:53:59,041 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 368df6736c0a028a52e8a16a42f4459b in 433ms, sequenceid=5, compaction requested=false 2023-10-29 23:53:59,042 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 368df6736c0a028a52e8a16a42f4459b: 2023-10-29 23:53:59,042 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:59,042 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:53:59,042 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:53:59,042 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,042 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-29 23:53:59,042 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-29 23:53:59,044 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,044 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:59,044 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,044 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:53:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:59,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:59,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:59,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-29 23:53:59,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10ac43c5[Count = 0] remaining members to acquire global barrier 2023-10-29 23:53:59,046 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-29 23:53:59,046 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,047 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,047 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,047 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:53:59,047 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-29 23:53:59,047 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-29 23:53:59,047 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:53:59,049 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-29 23:53:59,049 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:59,049 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,049 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-29 23:53:59,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:59,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:59,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:53:59,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-29 23:53:59,052 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-29 23:53:59,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:53:59,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:53:59,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,052 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:53:59,053 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:53:59,053 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:53:59,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,053 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:53:59,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:59,054 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:53:59,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,056 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:53:59,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,062 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,062 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:59,062 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:53:59,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:59,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-29 23:53:59,062 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:53:59,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-29 23:53:59,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:53:59,062 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:59,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,063 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-29 23:53:59,063 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:53:59,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:53:59,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:53:59,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,163 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:53:59,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:53:59,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:53:59,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-10-29 23:53:59,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,170 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-29 23:53:59,170 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:59,170 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-29 23:53:59,170 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-29 23:53:59,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,173 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,173 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:53:59,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:53:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:53:59,174 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:53:59,174 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:53:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,175 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,175 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-10-29 23:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-29 23:53:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-29 23:53:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:53:59,175 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. started... 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:59,176 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:53:59,176 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:59,176 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 368df6736c0a028a52e8a16a42f4459b 2/2 column families, dataSize=90 B heapSize=752 B 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. started... 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. started... 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d5dabbd5b853e6e71a0d5e5a22a35e46: 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1103e88b929851b6544b2e0f1f56c505: 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:53:59,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:53:59,176 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:53:59,177 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:53:59,592 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310291ecbe751196844d483d0ec6b98fd3f1f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310291ecbe751196844d483d0ec6b98fd3f1f 2023-10-29 23:53:59,997 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/.tmp/family1/9489d18c9601467080078824ec2ddfbf 2023-10-29 23:54:00,003 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/.tmp/family1/9489d18c9601467080078824ec2ddfbf as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/9489d18c9601467080078824ec2ddfbf 2023-10-29 23:54:00,007 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/9489d18c9601467080078824ec2ddfbf, entries=2, sequenceid=9, filesize=5.0 K 2023-10-29 23:54:00,008 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 368df6736c0a028a52e8a16a42f4459b in 832ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:00,008 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 368df6736c0a028a52e8a16a42f4459b: 2023-10-29 23:54:00,008 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:54:00,008 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:54:00,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:54:00,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-29 23:54:00,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-29 23:54:00,010 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,010 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:00,011 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,011 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:00,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-29 23:54:00,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4372ba24[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:00,012 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-29 23:54:00,012 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,014 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-29 23:54:00,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-29 23:54:00,015 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:00,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-29 23:54:00,016 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-29 23:54:00,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:00,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:00,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:00,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:00,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-29 23:54:00,019 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-29 23:54:00,019 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:00,019 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:00,019 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,019 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:00,020 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,020 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:00,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,020 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:00,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:00,021 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,022 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:00,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,024 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:00,025 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:00,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:00,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:00,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:00,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-29 23:54:00,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:00,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:00,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:00,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:00,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-29 23:54:00,025 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:00,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,026 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:00,026 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,026 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,126 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:00,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:00,134 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-10-29 23:54:00,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 23:54:00,136 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 23:54:00,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:00,136 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624240136 2023-10-29 23:54:00,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:00,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-10-29 23:54:00,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 23:54:00,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x144338f0 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:00,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cd35bd7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:00,143 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-29 23:54:00,973 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b8ca059cef4a4252b5ae497b2c3f45ca to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029b8ca059cef4a4252b5ae497b2c3f45ca 2023-10-29 23:54:00,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 23:54:00,994 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:54:00,996 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:54:01,005 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:54:01,007 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:54:01,018 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/757e9bb87cab451ab2709f3e4d7a30c7 first=Optional[k0] last=Optional[k1] 2023-10-29 23:54:01,018 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/757e9bb87cab451ab2709f3e4d7a30c7}] 2023-10-29 23:54:01,044 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:01,044 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x320123f9 to 127.0.0.1:50259 2023-10-29 23:54:01,045 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:01,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/757e9bb87cab451ab2709f3e4d7a30c7 for inclusion in 368df6736c0a028a52e8a16a42f4459b/family1 2023-10-29 23:54:01,046 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:01,046 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37d6d5c5 to 127.0.0.1:50259 2023-10-29 23:54:01,046 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:01,047 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:01,047 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00518424 to 127.0.0.1:50259 2023-10-29 23:54:01,047 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:01,047 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:01,047 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ee0c8fb to 127.0.0.1:50259 2023-10-29 23:54:01,047 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:01,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-10-29 23:54:01,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 23:54:01,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 368df6736c0a028a52e8a16a42f4459b: 2023-10-29 23:54:01,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/757e9bb87cab451ab2709f3e4d7a30c7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testScannerOnBulkLoadRefHFiles__rbjqad0ito7s1jq704tk034q0pv3kl8ls9fk5106i0q052rdqnu9tpiuf8446vhm/family1/757e9bb87cab451ab2709f3e4d7a30c7 2023-10-29 23:54:01,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testScannerOnBulkLoadRefHFiles__rbjqad0ito7s1jq704tk034q0pv3kl8ls9fk5106i0q052rdqnu9tpiuf8446vhm/family1/757e9bb87cab451ab2709f3e4d7a30c7 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_ 2023-10-29 23:54:01,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testScannerOnBulkLoadRefHFiles__rbjqad0ito7s1jq704tk034q0pv3kl8ls9fk5106i0q052rdqnu9tpiuf8446vhm/family1/757e9bb87cab451ab2709f3e4d7a30c7 into 368df6736c0a028a52e8a16a42f4459b/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_ - updating store file list. 2023-10-29 23:54:01,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_ into 368df6736c0a028a52e8a16a42f4459b/family1 2023-10-29 23:54:01,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testScannerOnBulkLoadRefHFiles__rbjqad0ito7s1jq704tk034q0pv3kl8ls9fk5106i0q052rdqnu9tpiuf8446vhm/family1/757e9bb87cab451ab2709f3e4d7a30c7 into 368df6736c0a028a52e8a16a42f4459b/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_) 2023-10-29 23:54:01,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testScannerOnBulkLoadRefHFiles__rbjqad0ito7s1jq704tk034q0pv3kl8ls9fk5106i0q052rdqnu9tpiuf8446vhm/family1/757e9bb87cab451ab2709f3e4d7a30c7 2023-10-29 23:54:01,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 23:54:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 23:54:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 368df6736c0a028a52e8a16a42f4459b/family1 is initiating minor compaction (all files) 2023-10-29 23:54:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@e8a6235; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:01,062 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 368df6736c0a028a52e8a16a42f4459b/family1 in testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:54:01,062 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/98ea8e7947df4da8baf6531232f9d5f4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/9489d18c9601467080078824ec2ddfbf, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/.tmp, totalSize=15.1 K 2023-10-29 23:54:01,062 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 98ea8e7947df4da8baf6531232f9d5f4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623638594 2023-10-29 23:54:01,063 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 9489d18c9601467080078824ec2ddfbf, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623638594 2023-10-29 23:54:01,063 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623638594 2023-10-29 23:54:01,064 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 23:54:01,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:01,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310291ecbe751196844d483d0ec6b98fd3f1f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310291ecbe751196844d483d0ec6b98fd3f1f 2023-10-29 23:54:01,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023102970b606d4ce264e3aa91d907efe5bf8dd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023102970b606d4ce264e3aa91d907efe5bf8dd 2023-10-29 23:54:01,068 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-10-29 23:54:01,068 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 23:54:01,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-29 23:54:01,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 23:54:01,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:01,070 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 23:54:01,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 937 msec 2023-10-29 23:54:01,076 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 368df6736c0a028a52e8a16a42f4459b#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:54:01,107 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=261 (was 261), OpenFileDescriptor=611 (was 629), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 231), ProcessCount=169 (was 169), AvailableMemoryMB=14313 (was 14392) 2023-10-29 23:54:01,121 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=261, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=169, AvailableMemoryMB=14313 2023-10-29 23:54:01,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 23:54:01,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:01,126 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:54:01,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-10-29 23:54:01,127 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:54:01,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 23:54:01,128 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:01,129 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf empty. 2023-10-29 23:54:01,129 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:01,130 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-10-29 23:54:01,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 23:54:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 23:54:01,540 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 23:54:01,541 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9604a801c866eb60838685d5f64f7edf, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:54:01,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 23:54:01,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:01,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 9604a801c866eb60838685d5f64f7edf, disabling compactions & flushes 2023-10-29 23:54:01,948 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:01,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:01,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. after waiting 0 ms 2023-10-29 23:54:01,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:01,948 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:01,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:01,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:54:01,951 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698623641951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623641951"}]},"ts":"1698623641951"} 2023-10-29 23:54:01,953 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:54:01,954 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:54:01,954 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623641954"}]},"ts":"1698623641954"} 2023-10-29 23:54:01,955 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-29 23:54:01,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9604a801c866eb60838685d5f64f7edf, ASSIGN}] 2023-10-29 23:54:01,960 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9604a801c866eb60838685d5f64f7edf, ASSIGN 2023-10-29 23:54:01,960 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9604a801c866eb60838685d5f64f7edf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:54:02,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9604a801c866eb60838685d5f64f7edf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:02,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698623642111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623642111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623642111"}]},"ts":"1698623642111"} 2023-10-29 23:54:02,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 9604a801c866eb60838685d5f64f7edf, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:02,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 23:54:02,265 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:02,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:02,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9604a801c866eb60838685d5f64f7edf, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:02,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:02,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:02,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:02,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:02,269 INFO [StoreOpener-9604a801c866eb60838685d5f64f7edf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:02,270 DEBUG [StoreOpener-9604a801c866eb60838685d5f64f7edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1 2023-10-29 23:54:02,271 DEBUG [StoreOpener-9604a801c866eb60838685d5f64f7edf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1 2023-10-29 23:54:02,271 INFO [StoreOpener-9604a801c866eb60838685d5f64f7edf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9604a801c866eb60838685d5f64f7edf columnFamilyName family1 2023-10-29 23:54:02,272 INFO [StoreOpener-9604a801c866eb60838685d5f64f7edf-1] regionserver.HStore(310): Store=9604a801c866eb60838685d5f64f7edf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:02,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:02,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:02,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9604a801c866eb60838685d5f64f7edf 2023-10-29 23:54:02,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:54:02,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9604a801c866eb60838685d5f64f7edf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70862765, jitterRate=0.05593748390674591}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:02,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:02,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf., pid=37, masterSystemTime=1698623642265 2023-10-29 23:54:02,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:02,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:02,283 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9604a801c866eb60838685d5f64f7edf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:02,283 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698623642283"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623642283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623642283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623642283"}]},"ts":"1698623642283"} 2023-10-29 23:54:02,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-29 23:54:02,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 9604a801c866eb60838685d5f64f7edf, server=jenkins-hbase4.apache.org,40533,1698623599827 in 171 msec 2023-10-29 23:54:02,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-10-29 23:54:02,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=9604a801c866eb60838685d5f64f7edf, ASSIGN in 327 msec 2023-10-29 23:54:02,287 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:54:02,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623642287"}]},"ts":"1698623642287"} 2023-10-29 23:54:02,289 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-29 23:54:02,291 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:54:02,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1680 sec 2023-10-29 23:54:02,296 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/.tmp/family1/f4d1fe221ab34112bcb106e14a46eec9 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/f4d1fe221ab34112bcb106e14a46eec9 2023-10-29 23:54:02,301 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 368df6736c0a028a52e8a16a42f4459b/family1 of 368df6736c0a028a52e8a16a42f4459b into f4d1fe221ab34112bcb106e14a46eec9(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:54:02,301 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 368df6736c0a028a52e8a16a42f4459b: 2023-10-29 23:54:02,301 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698623641062; duration=1sec 2023-10-29 23:54:02,301 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:02,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/98ea8e7947df4da8baf6531232f9d5f4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/9489d18c9601467080078824ec2ddfbf, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_] to archive 2023-10-29 23:54:02,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:02,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/98ea8e7947df4da8baf6531232f9d5f4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/98ea8e7947df4da8baf6531232f9d5f4 2023-10-29 23:54:02,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/9489d18c9601467080078824ec2ddfbf to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/9489d18c9601467080078824ec2ddfbf 2023-10-29 23:54:02,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/family1/3e0c8bb9f13e47a0aa6f6844047425bf_SeqId_12_ 2023-10-29 23:54:03,168 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:54:03,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 23:54:03,232 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-10-29 23:54:03,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:03,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,256 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:03,256 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:03,256 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:03,256 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:03,256 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,257 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,258 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:03,258 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:03,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:03,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:03,258 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:03,258 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:03,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:03,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,259 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:03,259 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:03,260 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:03,260 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:03,260 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:03,260 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 23:54:03,669 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:03,680 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308c1e6f9ea8474ebfab41f8170bbafbfe to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308c1e6f9ea8474ebfab41f8170bbafbfe 2023-10-29 23:54:04,084 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/581ee08511a0423ca1e544ed1106a4e6 2023-10-29 23:54:04,089 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/581ee08511a0423ca1e544ed1106a4e6 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/581ee08511a0423ca1e544ed1106a4e6 2023-10-29 23:54:04,094 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/581ee08511a0423ca1e544ed1106a4e6, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-29 23:54:04,094 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 834ms, sequenceid=5, compaction requested=false 2023-10-29 23:54:04,095 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:04,095 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:04,095 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:04,095 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:04,095 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,095 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:04,095 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:04,097 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,097 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:04,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:04,098 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,098 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:04,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:04,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:04,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:04,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:04,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@338ad3d1[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:04,099 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:04,099 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,100 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,101 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:04,101 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:04,101 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:04,101 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,101 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:04,103 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,103 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:04,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:04,103 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:04,103 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:04,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:04,106 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:04,106 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:04,106 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:04,106 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,106 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:04,107 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,107 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:04,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,107 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:04,108 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:04,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:04,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,110 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:04,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,112 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:04,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:04,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:04,112 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:04,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:04,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:04,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,113 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,213 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:04,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:04,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:04,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:04,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,220 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:04,220 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:04,220 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:04,220 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:04,220 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,220 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,223 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,223 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:04,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:04,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:04,223 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:04,223 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:04,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:04,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,224 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:04,224 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:04,224 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:04,224 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:04,224 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:04,225 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 23:54:04,638 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bbedb90170344039a90ca0317eb46b2f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128bbedb90170344039a90ca0317eb46b2f 2023-10-29 23:54:05,043 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/03db0a4d9b4f464e861ba2bf1fa44a2a 2023-10-29 23:54:05,048 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/03db0a4d9b4f464e861ba2bf1fa44a2a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/03db0a4d9b4f464e861ba2bf1fa44a2a 2023-10-29 23:54:05,053 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/03db0a4d9b4f464e861ba2bf1fa44a2a, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 23:54:05,053 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 829ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:05,054 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:05,054 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:05,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:05,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:05,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:05,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:05,055 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,055 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:05,056 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,056 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:05,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:05,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:05,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27c39a0b[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:05,057 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:05,057 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,061 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:05,061 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,061 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:05,063 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:05,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,063 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:05,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,063 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:05,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:05,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:05,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:05,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:05,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:05,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:05,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:05,066 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:05,066 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:05,066 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:05,066 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,067 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:05,068 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,068 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:05,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:05,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,068 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:05,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:05,069 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:05,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:05,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:05,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,070 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:05,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,072 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,072 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:05,072 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,072 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:05,072 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:05,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:05,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:05,072 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:05,072 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:05,073 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,073 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,073 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,073 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:05,073 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:05,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:05,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:05,173 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:05,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:05,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:05,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:05,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,181 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:05,181 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:05,181 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:05,181 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:05,181 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,181 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,183 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:05,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:05,183 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,183 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:05,183 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:05,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,184 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,184 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:05,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:05,184 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:05,184 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:05,184 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:05,184 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:05,597 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013504d665d0254f2bbf41fb2eba94f42c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013504d665d0254f2bbf41fb2eba94f42c 2023-10-29 23:54:06,003 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/2de98172778e4ac8b8840db5e2684176 2023-10-29 23:54:06,008 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/2de98172778e4ac8b8840db5e2684176 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/2de98172778e4ac8b8840db5e2684176 2023-10-29 23:54:06,013 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/2de98172778e4ac8b8840db5e2684176, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 23:54:06,013 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 829ms, sequenceid=13, compaction requested=true 2023-10-29 23:54:06,014 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:06,014 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:06,016 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,016 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:06,017 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,017 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:06,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:06,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5583475d[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:06,018 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:06,018 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,019 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:06,020 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:06,020 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:06,020 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,020 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:06,021 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:06,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,021 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:06,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:06,021 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:06,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:06,023 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:06,023 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:06,023 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:06,023 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,023 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:06,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:06,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,025 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:06,025 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:06,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,026 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:06,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:06,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,030 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:06,030 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:06,031 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,131 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:06,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:06,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:06,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,137 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:06,137 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:06,137 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:06,137 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:06,137 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,137 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,139 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,139 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:06,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:06,139 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,139 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,140 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:06,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:06,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:06,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:06,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:06,140 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:06,140 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:06,140 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:06,555 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205134e1d3713e9425e9f9a339bada8f7ce to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205134e1d3713e9425e9f9a339bada8f7ce 2023-10-29 23:54:06,960 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b 2023-10-29 23:54:06,965 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b 2023-10-29 23:54:06,969 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 23:54:06,970 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 830ms, sequenceid=17, compaction requested=true 2023-10-29 23:54:06,970 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:06,970 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:06,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:06,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:06,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:06,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:06,972 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,972 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:06,972 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,972 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:06,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:06,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3766453[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:06,974 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:06,974 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,975 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,975 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:06,975 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:06,975 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:06,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:06,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:06,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:06,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:06,977 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:06,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:06,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:06,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:06,980 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:06,980 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:06,980 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:06,980 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,980 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:06,981 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,981 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:06,981 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:06,982 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:06,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,984 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:06,986 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:06,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:06,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:06,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:06,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:06,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:06,986 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:06,987 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:07,087 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:07,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:07,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:07,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:07,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,093 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:07,093 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:07,093 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:07,093 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:07,093 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,093 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,094 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,094 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:07,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:07,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:07,095 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,095 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:07,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:07,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,095 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,096 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:07,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:07,096 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:07,096 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:07,096 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:07,511 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280a8068f746384981b2eafe2524bfc301 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280a8068f746384981b2eafe2524bfc301 2023-10-29 23:54:07,916 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/dba944d78b1049c9a9c8fbaeb44afffb 2023-10-29 23:54:07,921 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/dba944d78b1049c9a9c8fbaeb44afffb as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/dba944d78b1049c9a9c8fbaeb44afffb 2023-10-29 23:54:07,925 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/dba944d78b1049c9a9c8fbaeb44afffb, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 23:54:07,926 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 830ms, sequenceid=21, compaction requested=true 2023-10-29 23:54:07,926 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:07,926 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:07,926 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:07,926 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:07,926 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,927 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:07,927 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:07,931 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,931 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:07,931 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,931 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:07,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:07,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66873bb7[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:07,932 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:07,933 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,933 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,934 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:07,934 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:07,934 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:07,934 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,934 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:07,936 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:07,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:07,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:07,936 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:07,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:07,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:07,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:07,938 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:07,938 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:07,938 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:07,938 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,938 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:07,939 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,939 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:07,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,939 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:07,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:07,940 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,941 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:07,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:07,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:07,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:07,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:07,943 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:07,943 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:07,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:07,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:08,044 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:08,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:08,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:08,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:08,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,051 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:08,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:08,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:08,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:08,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:08,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:08,053 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,053 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:08,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:08,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,054 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,054 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:08,054 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:08,054 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:08,054 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:08,054 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:08,054 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:08,467 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a23af2e9f3b84562afe032efa12e7420 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a23af2e9f3b84562afe032efa12e7420 2023-10-29 23:54:08,872 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/e58ed0b95ef94463a3e87f4d0eb7a749 2023-10-29 23:54:08,877 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/e58ed0b95ef94463a3e87f4d0eb7a749 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/e58ed0b95ef94463a3e87f4d0eb7a749 2023-10-29 23:54:08,881 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/e58ed0b95ef94463a3e87f4d0eb7a749, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 23:54:08,882 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 828ms, sequenceid=25, compaction requested=true 2023-10-29 23:54:08,883 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:08,883 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:08,883 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:08,883 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:08,883 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,883 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:08,883 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:08,886 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,886 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:08,886 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,886 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dafe6ae[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:08,888 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:08,888 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,889 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,889 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:08,889 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:08,889 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:08,889 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,889 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:08,890 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:08,890 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,890 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:08,890 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:08,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:08,893 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:08,893 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:08,893 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:08,893 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,893 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:08,894 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,894 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:08,894 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:08,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:08,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:08,895 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,896 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,899 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,899 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:08,899 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:08,899 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:08,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:08,899 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:08,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:08,899 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:08,900 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:08,900 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:08,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:08,900 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,900 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:08,900 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:08,900 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:09,000 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:09,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:09,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:09,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:09,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,006 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:09,006 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:09,006 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:09,007 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:09,007 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,007 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,008 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,008 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:09,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:09,008 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,008 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:09,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:09,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,009 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,009 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:09,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:09,009 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:09,009 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:09,009 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:09,010 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:09,421 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d0010bf63b8d421d9508ee15107673e6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d0010bf63b8d421d9508ee15107673e6 2023-10-29 23:54:09,827 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/9688e46ddea94095bb3f653dd70db312 2023-10-29 23:54:09,832 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/9688e46ddea94095bb3f653dd70db312 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/9688e46ddea94095bb3f653dd70db312 2023-10-29 23:54:09,836 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/9688e46ddea94095bb3f653dd70db312, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 23:54:09,837 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 827ms, sequenceid=29, compaction requested=true 2023-10-29 23:54:09,837 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:09,838 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:09,839 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:09,840 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:09,840 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:09,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:09,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12d9fbe9[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:09,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:09,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,843 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:09,843 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:09,843 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:09,843 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,843 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:09,845 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:09,845 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,845 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:09,845 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:09,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:09,847 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:09,847 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:09,847 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:09,847 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,847 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:09,848 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,848 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:09,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:09,848 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:09,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:09,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:09,849 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,850 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:09,854 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:09,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:09,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:09,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 23:54:09,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:09,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:09,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:09,855 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,855 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,855 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:09,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:09,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:09,855 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:09,955 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:09,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:09,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:09,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:09,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,961 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:09,961 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:09,961 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:09,961 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:09,962 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,962 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,964 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,964 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:09,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:09,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:09,965 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:09,965 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:09,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:09,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,965 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,966 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:09,966 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:09,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:09,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:09,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:09,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:09,966 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:09,966 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:09,966 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:09,966 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:10,379 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010307d8e4c0e149459ba8ef1dcb864b528b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010307d8e4c0e149459ba8ef1dcb864b528b 2023-10-29 23:54:10,785 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/b05c9633003c456bbd46ab154e332439 2023-10-29 23:54:10,789 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/b05c9633003c456bbd46ab154e332439 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/b05c9633003c456bbd46ab154e332439 2023-10-29 23:54:10,793 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/b05c9633003c456bbd46ab154e332439, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 23:54:10,794 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 828ms, sequenceid=33, compaction requested=true 2023-10-29 23:54:10,794 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:10,794 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:10,796 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,796 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:10,796 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,796 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:10,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:10,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22bd411d[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:10,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:10,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,798 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,799 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:10,799 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:10,799 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:10,799 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,799 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:10,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:10,800 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:10,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:10,802 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:10,802 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:10,802 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:10,802 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,802 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:10,804 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,804 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:10,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,804 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:10,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:10,805 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,806 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,808 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:10,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:10,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,808 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:10,809 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:10,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:10,909 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:10,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:10,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:10,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:10,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,916 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:10,916 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:10,916 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:10,916 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:10,916 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,916 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,917 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,917 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:10,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:10,917 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:10,918 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:10,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,918 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,918 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:10,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:10,918 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:10,918 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:10,919 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:10,919 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:10,919 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:10,919 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:10,919 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:10,919 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:11,331 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cfbacbedf4994d13906fb21f7b8a6080 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907cfbacbedf4994d13906fb21f7b8a6080 2023-10-29 23:54:11,737 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/1df3ce7953484906bc050c97a7579d48 2023-10-29 23:54:11,741 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/1df3ce7953484906bc050c97a7579d48 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/1df3ce7953484906bc050c97a7579d48 2023-10-29 23:54:11,745 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/1df3ce7953484906bc050c97a7579d48, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 23:54:11,746 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 827ms, sequenceid=37, compaction requested=true 2023-10-29 23:54:11,746 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:11,746 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:11,746 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:11,746 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:11,746 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,746 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:11,747 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:11,748 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,748 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:11,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:11,748 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,748 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:11,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:11,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:11,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7db88c7e[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:11,750 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:11,750 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,752 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:11,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:11,753 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:11,755 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:11,755 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:11,755 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:11,755 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,755 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:11,756 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,757 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:11,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,757 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:11,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:11,757 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,758 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:11,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:11,760 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,760 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:11,761 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:11,861 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:11,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:11,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:11,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:11,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,867 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:11,867 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:11,867 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 23:54:11,867 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 23:54:11,867 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,867 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,870 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,870 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:11,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:11,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:11,870 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:11,870 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:11,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:11,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,871 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,871 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 23:54:11,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:11,871 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 23:54:11,871 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:11,871 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 23:54:11,871 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:11,871 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:11,871 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:11,871 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. started... 2023-10-29 23:54:11,871 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9604a801c866eb60838685d5f64f7edf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:12,285 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120111cbccb373c471797942bf2e25042fe to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120111cbccb373c471797942bf2e25042fe 2023-10-29 23:54:12,690 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/666d0ef39dc44a309a1809acb7150bcc 2023-10-29 23:54:12,695 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/666d0ef39dc44a309a1809acb7150bcc as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/666d0ef39dc44a309a1809acb7150bcc 2023-10-29 23:54:12,699 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/666d0ef39dc44a309a1809acb7150bcc, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 23:54:12,699 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9604a801c866eb60838685d5f64f7edf in 828ms, sequenceid=41, compaction requested=true 2023-10-29 23:54:12,700 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:12,700 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 23:54:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 23:54:12,702 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,702 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:12,702 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,702 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:12,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 23:54:12,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f009ff1[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:12,703 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 23:54:12,703 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,704 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,704 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 23:54:12,704 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 23:54:12,704 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:12,705 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,705 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 23:54:12,706 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 23:54:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:12,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:54:12,708 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 23:54:12,708 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:12,708 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:12,708 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,708 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:12,710 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,710 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:12,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,711 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:12,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:12,711 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,712 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,717 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,717 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:12,717 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:12,717 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:12,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:12,717 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 23:54:12,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:12,717 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:12,718 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:12,718 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,718 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:12,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:12,718 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:12,718 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,718 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:12,818 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:12,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:12,820 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-10-29 23:54:12,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:54:12,822 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:54:12,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:12,823 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624252823 2023-10-29 23:54:12,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:12,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-29 23:54:12,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:54:12,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x3c771da2 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:12,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70dd0f59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:12,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,667 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010392aa45a1f62c4ade8b549762addd365f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010392aa45a1f62c4ade8b549762addd365f 2023-10-29 23:54:13,668 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:54:13,681 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:54:13,682 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:54:13,687 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:54:13,688 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:54:13,696 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4c676ad87a0436ea58770d2cfc3b9b0 first=Optional[r3] last=Optional[r6] 2023-10-29 23:54:13,697 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4c676ad87a0436ea58770d2cfc3b9b0}] 2023-10-29 23:54:13,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4c676ad87a0436ea58770d2cfc3b9b0 for inclusion in 9604a801c866eb60838685d5f64f7edf/family1 2023-10-29 23:54:13,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 23:54:13,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:13,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:13,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4c676ad87a0436ea58770d2cfc3b9b0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j0obbs9dkqj4hqvaae1jt6r45fd0bjdujud6v6pl1gkhlp78t9tiu1101a3qqrnh/family1/e4c676ad87a0436ea58770d2cfc3b9b0 2023-10-29 23:54:13,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j0obbs9dkqj4hqvaae1jt6r45fd0bjdujud6v6pl1gkhlp78t9tiu1101a3qqrnh/family1/e4c676ad87a0436ea58770d2cfc3b9b0 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_ 2023-10-29 23:54:13,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j0obbs9dkqj4hqvaae1jt6r45fd0bjdujud6v6pl1gkhlp78t9tiu1101a3qqrnh/family1/e4c676ad87a0436ea58770d2cfc3b9b0 into 9604a801c866eb60838685d5f64f7edf/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_ - updating store file list. 2023-10-29 23:54:13,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_ into 9604a801c866eb60838685d5f64f7edf/family1 2023-10-29 23:54:13,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j0obbs9dkqj4hqvaae1jt6r45fd0bjdujud6v6pl1gkhlp78t9tiu1101a3qqrnh/family1/e4c676ad87a0436ea58770d2cfc3b9b0 into 9604a801c866eb60838685d5f64f7edf/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_) 2023-10-29 23:54:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__j0obbs9dkqj4hqvaae1jt6r45fd0bjdujud6v6pl1gkhlp78t9tiu1101a3qqrnh/family1/e4c676ad87a0436ea58770d2cfc3b9b0 2023-10-29 23:54:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 23:54:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 23:54:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 9604a801c866eb60838685d5f64f7edf/family1 is initiating minor compaction 2023-10-29 23:54:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@65bea35d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:13,713 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9604a801c866eb60838685d5f64f7edf/family1 in testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:13,713 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/03db0a4d9b4f464e861ba2bf1fa44a2a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/2de98172778e4ac8b8840db5e2684176, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/dba944d78b1049c9a9c8fbaeb44afffb, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/e58ed0b95ef94463a3e87f4d0eb7a749, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/9688e46ddea94095bb3f653dd70db312, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/b05c9633003c456bbd46ab154e332439, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/1df3ce7953484906bc050c97a7579d48, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/666d0ef39dc44a309a1809acb7150bcc, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp, totalSize=50.0 K 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 03db0a4d9b4f464e861ba2bf1fa44a2a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 2de98172778e4ac8b8840db5e2684176, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d70dc9b1b5ab47c1a93bfbc30b8df72b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting dba944d78b1049c9a9c8fbaeb44afffb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting e58ed0b95ef94463a3e87f4d0eb7a749, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 9688e46ddea94095bb3f653dd70db312, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting b05c9633003c456bbd46ab154e332439, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1df3ce7953484906bc050c97a7579d48, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 666d0ef39dc44a309a1809acb7150bcc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 23:54:13,714 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 6a7caf560b4049f6807545f4e5e005e6_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 23:54:13,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:54:13,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:13,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280a8068f746384981b2eafe2524bfc301 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280a8068f746384981b2eafe2524bfc301 2023-10-29 23:54:13,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a23af2e9f3b84562afe032efa12e7420 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a23af2e9f3b84562afe032efa12e7420 2023-10-29 23:54:13,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d0010bf63b8d421d9508ee15107673e6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d0010bf63b8d421d9508ee15107673e6 2023-10-29 23:54:13,720 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010307d8e4c0e149459ba8ef1dcb864b528b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010307d8e4c0e149459ba8ef1dcb864b528b 2023-10-29 23:54:13,720 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-29 23:54:13,720 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:13,751 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9604a801c866eb60838685d5f64f7edf#family1#compaction#48 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:54:14,193 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/3c8d884cb532452b8e9a7265892d6abd as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/3c8d884cb532452b8e9a7265892d6abd 2023-10-29 23:54:14,197 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9604a801c866eb60838685d5f64f7edf/family1 of 9604a801c866eb60838685d5f64f7edf into 3c8d884cb532452b8e9a7265892d6abd(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:54:14,197 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:14,198 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698623653713; duration=0sec 2023-10-29 23:54:14,198 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:14,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/03db0a4d9b4f464e861ba2bf1fa44a2a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/2de98172778e4ac8b8840db5e2684176, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/dba944d78b1049c9a9c8fbaeb44afffb, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/e58ed0b95ef94463a3e87f4d0eb7a749, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/9688e46ddea94095bb3f653dd70db312, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/b05c9633003c456bbd46ab154e332439, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/1df3ce7953484906bc050c97a7579d48, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/666d0ef39dc44a309a1809acb7150bcc, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_] to archive 2023-10-29 23:54:14,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:14,225 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/03db0a4d9b4f464e861ba2bf1fa44a2a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/03db0a4d9b4f464e861ba2bf1fa44a2a 2023-10-29 23:54:14,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/2de98172778e4ac8b8840db5e2684176 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/2de98172778e4ac8b8840db5e2684176 2023-10-29 23:54:14,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/d70dc9b1b5ab47c1a93bfbc30b8df72b 2023-10-29 23:54:14,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/dba944d78b1049c9a9c8fbaeb44afffb to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/dba944d78b1049c9a9c8fbaeb44afffb 2023-10-29 23:54:14,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/e58ed0b95ef94463a3e87f4d0eb7a749 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/e58ed0b95ef94463a3e87f4d0eb7a749 2023-10-29 23:54:14,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/9688e46ddea94095bb3f653dd70db312 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/9688e46ddea94095bb3f653dd70db312 2023-10-29 23:54:14,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/b05c9633003c456bbd46ab154e332439 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/b05c9633003c456bbd46ab154e332439 2023-10-29 23:54:14,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/1df3ce7953484906bc050c97a7579d48 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/1df3ce7953484906bc050c97a7579d48 2023-10-29 23:54:14,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/666d0ef39dc44a309a1809acb7150bcc to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/666d0ef39dc44a309a1809acb7150bcc 2023-10-29 23:54:14,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/6a7caf560b4049f6807545f4e5e005e6_SeqId_44_ 2023-10-29 23:54:14,586 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120534071346c3724a9280ad18c3e04cdd5c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120534071346c3724a9280ad18c3e04cdd5c 2023-10-29 23:54:14,587 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:54:14,612 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e836d9b9f5b549378e92279d2d38e869 first=Optional[r00] last=Optional[r2] 2023-10-29 23:54:14,613 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e836d9b9f5b549378e92279d2d38e869}] 2023-10-29 23:54:14,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e836d9b9f5b549378e92279d2d38e869 for inclusion in 9604a801c866eb60838685d5f64f7edf/family1 2023-10-29 23:54:14,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 23:54:14,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:14,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:14,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e836d9b9f5b549378e92279d2d38e869 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p5abpkn3gsrr9o0eu1ovd0kea8agibdh45ghf54028vggr9ih9gtqcthdq3qpdsk/family1/e836d9b9f5b549378e92279d2d38e869 2023-10-29 23:54:14,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p5abpkn3gsrr9o0eu1ovd0kea8agibdh45ghf54028vggr9ih9gtqcthdq3qpdsk/family1/e836d9b9f5b549378e92279d2d38e869 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_ 2023-10-29 23:54:14,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p5abpkn3gsrr9o0eu1ovd0kea8agibdh45ghf54028vggr9ih9gtqcthdq3qpdsk/family1/e836d9b9f5b549378e92279d2d38e869 into 9604a801c866eb60838685d5f64f7edf/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_ - updating store file list. 2023-10-29 23:54:14,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_ into 9604a801c866eb60838685d5f64f7edf/family1 2023-10-29 23:54:14,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p5abpkn3gsrr9o0eu1ovd0kea8agibdh45ghf54028vggr9ih9gtqcthdq3qpdsk/family1/e836d9b9f5b549378e92279d2d38e869 into 9604a801c866eb60838685d5f64f7edf/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_) 2023-10-29 23:54:14,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyPolicy__p5abpkn3gsrr9o0eu1ovd0kea8agibdh45ghf54028vggr9ih9gtqcthdq3qpdsk/family1/e836d9b9f5b549378e92279d2d38e869 2023-10-29 23:54:14,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 23:54:14,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 23:54:14,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 9604a801c866eb60838685d5f64f7edf/family1 is initiating minor compaction (all files) 2023-10-29 23:54:14,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4ea8d59d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:14,627 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9604a801c866eb60838685d5f64f7edf/family1 in testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:54:14,628 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/581ee08511a0423ca1e544ed1106a4e6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/3c8d884cb532452b8e9a7265892d6abd, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp, totalSize=337.0 K 2023-10-29 23:54:14,628 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 581ee08511a0423ca1e544ed1106a4e6, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823369 2023-10-29 23:54:14,628 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 3c8d884cb532452b8e9a7265892d6abd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223369 2023-10-29 23:54:14,629 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823369 2023-10-29 23:54:14,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:54:14,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:14,631 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308c1e6f9ea8474ebfab41f8170bbafbfe to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511308c1e6f9ea8474ebfab41f8170bbafbfe 2023-10-29 23:54:14,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013504d665d0254f2bbf41fb2eba94f42c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013504d665d0254f2bbf41fb2eba94f42c 2023-10-29 23:54:14,634 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205134e1d3713e9425e9f9a339bada8f7ce to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205134e1d3713e9425e9f9a339bada8f7ce 2023-10-29 23:54:14,634 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-10-29 23:54:14,634 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 23:54:14,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 23:54:14,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 23:54:14,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:14,636 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:54:14,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8150 sec 2023-10-29 23:54:14,644 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9604a801c866eb60838685d5f64f7edf#family1#compaction#49 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:54:14,731 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=261 (was 261), OpenFileDescriptor=624 (was 611) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 221), ProcessCount=169 (was 169), AvailableMemoryMB=14294 (was 14313) 2023-10-29 23:54:14,742 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=261, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=169, AvailableMemoryMB=14293 2023-10-29 23:54:14,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 23:54:14,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:14,746 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:54:14,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-10-29 23:54:14,747 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:54:14,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 23:54:14,748 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:14,748 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 empty. 2023-10-29 23:54:14,749 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:14,749 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-10-29 23:54:14,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 23:54:15,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 23:54:15,157 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-29 23:54:15,158 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => e3be6f486f3c65a567087911fc90d6e4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:54:15,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 23:54:15,563 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:15,563 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing e3be6f486f3c65a567087911fc90d6e4, disabling compactions & flushes 2023-10-29 23:54:15,564 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:15,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:15,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. after waiting 0 ms 2023-10-29 23:54:15,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:15,564 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:15,564 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:15,566 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:54:15,567 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623655567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623655567"}]},"ts":"1698623655567"} 2023-10-29 23:54:15,568 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:54:15,569 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:54:15,569 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623655569"}]},"ts":"1698623655569"} 2023-10-29 23:54:15,570 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-10-29 23:54:15,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, ASSIGN}] 2023-10-29 23:54:15,575 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, ASSIGN 2023-10-29 23:54:15,576 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:54:15,727 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:15,727 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623655727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623655727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623655727"}]},"ts":"1698623655727"} 2023-10-29 23:54:15,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:15,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 23:54:15,861 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/.tmp/family1/568e18a5bf8049a4987d1a0f3fa67b95 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/568e18a5bf8049a4987d1a0f3fa67b95 2023-10-29 23:54:15,866 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9604a801c866eb60838685d5f64f7edf/family1 of 9604a801c866eb60838685d5f64f7edf into 568e18a5bf8049a4987d1a0f3fa67b95(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:54:15,866 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:54:15,866 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1698623654627; duration=1sec 2023-10-29 23:54:15,866 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:15,880 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:15,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:15,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3be6f486f3c65a567087911fc90d6e4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:15,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:15,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:15,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:15,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:15,884 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:15,885 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:15,885 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:15,885 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3be6f486f3c65a567087911fc90d6e4 columnFamilyName family1 2023-10-29 23:54:15,887 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(310): Store=e3be6f486f3c65a567087911fc90d6e4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:15,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:15,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:15,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:15,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:54:15,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e3be6f486f3c65a567087911fc90d6e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73423243, jitterRate=0.09409157931804657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:15,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:15,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., pid=41, masterSystemTime=1698623655880 2023-10-29 23:54:15,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:15,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:15,895 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:15,895 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623655895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623655895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623655895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623655895"}]},"ts":"1698623655895"} 2023-10-29 23:54:15,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-10-29 23:54:15,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827 in 168 msec 2023-10-29 23:54:15,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-10-29 23:54:15,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, ASSIGN in 324 msec 2023-10-29 23:54:15,900 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:54:15,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623655900"}]},"ts":"1698623655900"} 2023-10-29 23:54:15,901 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-10-29 23:54:15,903 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:54:15,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1590 sec 2023-10-29 23:54:15,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/581ee08511a0423ca1e544ed1106a4e6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/3c8d884cb532452b8e9a7265892d6abd, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_] to archive 2023-10-29 23:54:15,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:15,913 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/581ee08511a0423ca1e544ed1106a4e6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/581ee08511a0423ca1e544ed1106a4e6 2023-10-29 23:54:15,914 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/3c8d884cb532452b8e9a7265892d6abd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/3c8d884cb532452b8e9a7265892d6abd 2023-10-29 23:54:15,915 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/family1/a4d6ca31ea814b0abb1c277237e470d9_SeqId_47_ 2023-10-29 23:54:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 23:54:16,852 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-10-29 23:54:16,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:16,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,877 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:16,877 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:16,877 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:16,877 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:16,877 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,877 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,878 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:16,878 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:16,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:16,879 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:16,879 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:16,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:16,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,879 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:16,880 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:16,880 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:16,880 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:16,880 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:16,880 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:16,880 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:16,880 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:16,881 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 23:54:17,301 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c207b2dc1f334e47b46e7d92b8eb2e4a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c207b2dc1f334e47b46e7d92b8eb2e4a 2023-10-29 23:54:17,705 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/3d515b1c22ed42289e343e0958e32c11 2023-10-29 23:54:17,709 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/3d515b1c22ed42289e343e0958e32c11 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d515b1c22ed42289e343e0958e32c11 2023-10-29 23:54:17,713 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d515b1c22ed42289e343e0958e32c11, entries=1000, sequenceid=5, filesize=191.4 K 2023-10-29 23:54:17,714 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 833ms, sequenceid=5, compaction requested=false 2023-10-29 23:54:17,714 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:17,714 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:17,714 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:17,717 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,717 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:17,717 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,717 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:17,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:17,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25b314b[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:17,718 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:17,718 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,720 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:17,720 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:17,720 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,720 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:17,721 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,721 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:17,723 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:17,723 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:17,723 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:17,723 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,723 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:17,725 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,725 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:17,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,725 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:17,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:17,725 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:17,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,726 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:17,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:17,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:17,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 23:54:17,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,729 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:17,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:17,730 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:17,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:17,730 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:17,729 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,730 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,730 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:17,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:17,830 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:17,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:17,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,836 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:17,836 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:17,836 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:17,836 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:17,837 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,837 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,838 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:17,838 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:17,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:17,838 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:17,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,838 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:17,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:17,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,839 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:17,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:17,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:17,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:17,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:17,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:17,839 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:17,839 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:17,839 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:17,840 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 23:54:18,251 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b53f19b4bf6e4c82afc8e19c0567e024 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b53f19b4bf6e4c82afc8e19c0567e024 2023-10-29 23:54:18,656 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/96fd015cb2534969b459c5db9f14107a 2023-10-29 23:54:18,662 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/96fd015cb2534969b459c5db9f14107a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/96fd015cb2534969b459c5db9f14107a 2023-10-29 23:54:18,666 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/96fd015cb2534969b459c5db9f14107a, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 23:54:18,667 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 827ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:18,667 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:18,667 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:18,667 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:18,667 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:18,667 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,667 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:18,667 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:18,669 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:18,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:18,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:18,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:18,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aa63db4[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:18,671 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:18,671 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,672 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:18,672 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,672 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:18,675 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,675 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:18,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:18,677 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:18,678 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:18,678 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:18,678 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,678 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:18,679 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:18,679 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,679 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:18,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:18,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:18,680 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:18,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,681 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,688 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,688 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:18,688 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:18,688 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:18,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:18,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:18,688 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,688 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:18,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:18,689 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:18,689 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:18,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:18,789 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:18,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:18,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:18,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:18,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,795 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:18,795 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:18,795 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:18,795 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:18,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,798 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:18,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:18,799 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:18,799 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,800 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:18,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:18,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:18,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:18,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:18,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:18,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:18,800 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:18,800 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:18,800 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:19,212 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e1dae9e6c1034caf86a3dd70790a187f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e1dae9e6c1034caf86a3dd70790a187f 2023-10-29 23:54:19,618 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/fc88e632a8d14908bfc148e50e415e2d 2023-10-29 23:54:19,623 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/fc88e632a8d14908bfc148e50e415e2d as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fc88e632a8d14908bfc148e50e415e2d 2023-10-29 23:54:19,627 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fc88e632a8d14908bfc148e50e415e2d, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 23:54:19,627 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 827ms, sequenceid=13, compaction requested=true 2023-10-29 23:54:19,627 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:19,627 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:19,627 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:19,628 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:19,628 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,628 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:19,628 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:19,629 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:19,629 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,629 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:19,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:19,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@734483e2[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:19,631 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:19,631 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,632 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:19,632 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,632 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:19,633 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,633 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:19,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:19,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:19,633 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:19,633 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:19,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:19,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:19,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:19,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:19,635 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:19,635 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:19,635 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:19,635 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,635 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:19,638 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,638 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,638 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:19,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:19,638 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,640 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,641 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:19,642 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:19,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:19,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:19,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:19,642 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:19,742 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:19,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:19,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:19,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:19,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,749 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:19,749 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:19,749 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:19,749 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:19,749 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,749 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,750 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,750 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:19,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:19,751 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:19,751 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,751 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,752 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:19,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:19,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:19,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:19,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:19,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:19,752 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:19,752 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:19,752 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:19,752 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:20,164 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dc60c58a7a5541e5a1dcc0cb4d77d3a9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc60c58a7a5541e5a1dcc0cb4d77d3a9 2023-10-29 23:54:20,569 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/60da48c319a24d57aa84c9f54abeac64 2023-10-29 23:54:20,574 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/60da48c319a24d57aa84c9f54abeac64 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/60da48c319a24d57aa84c9f54abeac64 2023-10-29 23:54:20,577 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/60da48c319a24d57aa84c9f54abeac64, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 23:54:20,578 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 826ms, sequenceid=17, compaction requested=true 2023-10-29 23:54:20,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:20,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:20,578 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:20,580 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,580 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:20,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:20,581 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,581 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:20,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:20,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:20,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:20,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:20,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2860756c[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:20,582 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:20,582 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,584 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:20,584 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,584 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:20,585 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:20,585 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:20,585 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,585 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:20,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:20,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:20,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:20,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:20,587 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:20,587 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:20,587 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:20,587 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,587 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:20,589 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,589 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:20,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,589 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:20,589 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,590 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:20,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,592 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,592 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:20,592 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:20,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:20,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:20,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:20,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:20,593 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,593 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:20,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:20,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:20,693 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:20,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:20,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:20,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:20,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,699 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:20,699 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:20,699 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:20,699 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:20,700 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,700 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,706 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:20,706 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:20,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:20,706 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:20,706 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:20,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:20,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,707 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,707 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:20,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:20,707 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:20,707 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:20,707 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:20,707 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:20,707 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:20,707 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:20,708 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:20,708 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:21,120 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286e1480af1c9b4f3b81ae7e98bcad3326 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286e1480af1c9b4f3b81ae7e98bcad3326 2023-10-29 23:54:21,232 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-10-29 23:54:21,416 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:54:21,526 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/8c36e4e19e9c462aba26af853ea8d6d1 2023-10-29 23:54:21,531 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/8c36e4e19e9c462aba26af853ea8d6d1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/8c36e4e19e9c462aba26af853ea8d6d1 2023-10-29 23:54:21,535 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/8c36e4e19e9c462aba26af853ea8d6d1, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 23:54:21,536 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 828ms, sequenceid=21, compaction requested=true 2023-10-29 23:54:21,536 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:21,536 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:21,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:21,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:21,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:21,536 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:21,540 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,540 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:21,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:21,540 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,540 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:21,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:21,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:21,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:21,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:21,542 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:21,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73eac842[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:21,542 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,543 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,543 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:21,543 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:21,543 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:21,544 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,544 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:21,545 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,545 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:21,545 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:21,545 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:21,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:21,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:21,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:21,547 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:21,547 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:21,547 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:21,547 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,547 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:21,548 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,548 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:21,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:21,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,548 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:21,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:21,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:21,549 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,550 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:21,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:21,552 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:21,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:21,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:21,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:21,552 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,553 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,553 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:21,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:21,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:21,553 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:21,653 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:21,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:21,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:21,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:21,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,659 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:21,659 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:21,659 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:21,659 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:21,659 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,659 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,661 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:21,661 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:21,662 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:21,662 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,663 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:21,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:21,663 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:21,663 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:21,663 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:22,076 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231826aae96d5414859b4d6f288e714c160 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231826aae96d5414859b4d6f288e714c160 2023-10-29 23:54:22,481 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/63466131395f49a7b8e428f7b6854ad3 2023-10-29 23:54:22,486 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/63466131395f49a7b8e428f7b6854ad3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/63466131395f49a7b8e428f7b6854ad3 2023-10-29 23:54:22,490 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/63466131395f49a7b8e428f7b6854ad3, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 23:54:22,491 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 828ms, sequenceid=25, compaction requested=true 2023-10-29 23:54:22,491 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:22,491 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:22,491 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:22,491 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:22,491 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,491 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:22,491 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:22,493 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,493 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:22,493 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,493 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:22,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:22,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:22,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@85a1016[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:22,494 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:22,494 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,495 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,495 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:22,495 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:22,495 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:22,495 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,495 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:22,498 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,498 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:22,498 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:22,498 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:22,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:22,500 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:22,500 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:22,500 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:22,500 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,500 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:22,501 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,501 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,501 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:22,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:22,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:22,502 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,503 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:22,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:22,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:22,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:22,505 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:22,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:22,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:22,505 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,506 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,506 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,606 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:22,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:22,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:22,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:22,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,612 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:22,612 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:22,612 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:22,612 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:22,612 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,612 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,613 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,613 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:22,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:22,614 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:22,614 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:22,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,615 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:22,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:22,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:22,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:22,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:22,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:22,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:22,615 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:22,615 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:22,615 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:23,027 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010100dc1aef8cc64965a3a4978279aea865 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010100dc1aef8cc64965a3a4978279aea865 2023-10-29 23:54:23,432 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/cc751b7daa864ff290d82189bdbecda7 2023-10-29 23:54:23,438 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/cc751b7daa864ff290d82189bdbecda7 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/cc751b7daa864ff290d82189bdbecda7 2023-10-29 23:54:23,443 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/cc751b7daa864ff290d82189bdbecda7, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 23:54:23,444 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 829ms, sequenceid=29, compaction requested=true 2023-10-29 23:54:23,444 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:23,444 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:23,444 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:23,444 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:23,444 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,444 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:23,444 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:23,446 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,446 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:23,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:23,446 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,446 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:23,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:23,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:23,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:23,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:23,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fd6c96c[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:23,448 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:23,448 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,449 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:23,449 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,449 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:23,450 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:23,450 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:23,450 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,450 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:23,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:23,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:23,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:23,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:23,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:23,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:23,453 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:23,453 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:23,453 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:23,453 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,453 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:23,458 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,458 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:23,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:23,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,458 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:23,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:23,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:23,458 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:23,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:23,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,460 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:23,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,462 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:23,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:23,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:23,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:23,563 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:23,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:23,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:23,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:23,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,569 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:23,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:23,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:23,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:23,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,570 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:23,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:23,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:23,570 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,571 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:23,571 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:23,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:23,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,571 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,571 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:23,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:23,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:23,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:23,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:23,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:23,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:23,572 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:23,572 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:23,572 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:23,984 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e042603e0c0f426eac01df00cf81e4f1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e042603e0c0f426eac01df00cf81e4f1 2023-10-29 23:54:24,389 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/0e4d5fe0f7e94977bdde94fb90a01ea2 2023-10-29 23:54:24,394 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/0e4d5fe0f7e94977bdde94fb90a01ea2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0e4d5fe0f7e94977bdde94fb90a01ea2 2023-10-29 23:54:24,398 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0e4d5fe0f7e94977bdde94fb90a01ea2, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 23:54:24,399 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 827ms, sequenceid=33, compaction requested=true 2023-10-29 23:54:24,399 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:24,399 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:24,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:24,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:24,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:24,399 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:24,401 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,401 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:24,401 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,401 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:24,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:24,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74361cef[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:24,402 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:24,402 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,404 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,404 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:24,404 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:24,404 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:24,404 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,404 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:24,405 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:24,405 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:24,405 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,405 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:24,407 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:24,408 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:24,408 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:24,408 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,408 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:24,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:24,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,409 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:24,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:24,410 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,411 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:24,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:24,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:24,413 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,413 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,513 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:24,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:24,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:24,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:24,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,519 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:24,519 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:24,519 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:24,519 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:24,520 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,520 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,522 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:24,522 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:24,522 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:24,522 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:24,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,523 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,523 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:24,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:24,523 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:24,523 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:24,523 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:24,524 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:24,524 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:24,524 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:24,524 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:24,524 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:24,935 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072ddcfa5468a64f3a923133bb80707ab6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509072ddcfa5468a64f3a923133bb80707ab6 2023-10-29 23:54:25,340 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/1e903d070f51485fb228e018c1e416d6 2023-10-29 23:54:25,345 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/1e903d070f51485fb228e018c1e416d6 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/1e903d070f51485fb228e018c1e416d6 2023-10-29 23:54:25,349 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/1e903d070f51485fb228e018c1e416d6, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 23:54:25,350 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 826ms, sequenceid=37, compaction requested=true 2023-10-29 23:54:25,350 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:25,350 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:25,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:25,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:25,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:25,350 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:25,351 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,351 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:25,352 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,352 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:25,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:25,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51bb62f3[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:25,353 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:25,353 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,354 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,354 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:25,355 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:25,355 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,355 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:25,355 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:25,357 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:25,357 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:25,357 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,357 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:25,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:25,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:25,359 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:25,359 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:25,359 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:25,359 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,359 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:25,361 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,361 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:25,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,361 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:25,361 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,362 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:25,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 23:54:25,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:25,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:25,367 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:25,367 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:25,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:25,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:25,467 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:25,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:25,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:25,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,474 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:25,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:25,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 23:54:25,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 23:54:25,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,477 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,477 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:25,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:25,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:25,477 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:25,477 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:25,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:25,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,478 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 23:54:25,478 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 23:54:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 23:54:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:25,478 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:25,478 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. started... 2023-10-29 23:54:25,478 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e3be6f486f3c65a567087911fc90d6e4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:25,891 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d60a7d5578924b26ba76be57f876a5c0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120d60a7d5578924b26ba76be57f876a5c0 2023-10-29 23:54:26,297 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/d23d48f9f8694005b1ee8dc2cc93905e 2023-10-29 23:54:26,301 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/d23d48f9f8694005b1ee8dc2cc93905e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/d23d48f9f8694005b1ee8dc2cc93905e 2023-10-29 23:54:26,305 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/d23d48f9f8694005b1ee8dc2cc93905e, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 23:54:26,306 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3be6f486f3c65a567087911fc90d6e4 in 828ms, sequenceid=41, compaction requested=true 2023-10-29 23:54:26,306 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:26,306 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 23:54:26,306 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 23:54:26,307 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,307 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:26,308 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,308 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 23:54:26,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9391272[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:26,309 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 23:54:26,309 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,310 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,310 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 23:54:26,310 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 23:54:26,310 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:26,310 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,310 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:26,312 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 23:54:26,312 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,312 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:26,312 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 23:54:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:26,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:26,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 23:54:26,314 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 23:54:26,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:26,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:26,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,314 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:26,316 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,316 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:26,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,316 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:26,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:26,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:26,317 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,318 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:26,320 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:26,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 23:54:26,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 23:54:26,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:26,320 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:26,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:26,420 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:26,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:26,422 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:26,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:26,425 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:26,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:26,425 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624266425 2023-10-29 23:54:26,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:26,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 23:54:26,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:26,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x30eb4b57 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:26,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28542dd4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:26,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,278 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036c9c2941cd5442bb899c87afe6c88411 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036c9c2941cd5442bb899c87afe6c88411 2023-10-29 23:54:27,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:27,292 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:54:27,293 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:54:27,299 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:54:27,301 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:54:27,311 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/501b025c14914576849e02d12e42d54b first=Optional[r3] last=Optional[r6] 2023-10-29 23:54:27,312 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/501b025c14914576849e02d12e42d54b}] 2023-10-29 23:54:27,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/501b025c14914576849e02d12e42d54b for inclusion in e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:27,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 23:54:27,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:27,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:27,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/501b025c14914576849e02d12e42d54b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2empkueudkmkqb0uf5tt159f44k8qc8l137cc7nfnf6jlqb5u6b2bn3jkv1vugo7/family1/501b025c14914576849e02d12e42d54b 2023-10-29 23:54:27,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2empkueudkmkqb0uf5tt159f44k8qc8l137cc7nfnf6jlqb5u6b2bn3jkv1vugo7/family1/501b025c14914576849e02d12e42d54b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_ 2023-10-29 23:54:27,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2empkueudkmkqb0uf5tt159f44k8qc8l137cc7nfnf6jlqb5u6b2bn3jkv1vugo7/family1/501b025c14914576849e02d12e42d54b into e3be6f486f3c65a567087911fc90d6e4/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_ - updating store file list. 2023-10-29 23:54:27,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_ into e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:27,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2empkueudkmkqb0uf5tt159f44k8qc8l137cc7nfnf6jlqb5u6b2bn3jkv1vugo7/family1/501b025c14914576849e02d12e42d54b into e3be6f486f3c65a567087911fc90d6e4/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_) 2023-10-29 23:54:27,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2empkueudkmkqb0uf5tt159f44k8qc8l137cc7nfnf6jlqb5u6b2bn3jkv1vugo7/family1/501b025c14914576849e02d12e42d54b 2023-10-29 23:54:27,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 23:54:27,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 23:54:27,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): e3be6f486f3c65a567087911fc90d6e4/family1 is initiating minor compaction 2023-10-29 23:54:27,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@434e60e1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:27,329 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e3be6f486f3c65a567087911fc90d6e4/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:27,329 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/96fd015cb2534969b459c5db9f14107a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fc88e632a8d14908bfc148e50e415e2d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/60da48c319a24d57aa84c9f54abeac64, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/8c36e4e19e9c462aba26af853ea8d6d1, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/63466131395f49a7b8e428f7b6854ad3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/cc751b7daa864ff290d82189bdbecda7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0e4d5fe0f7e94977bdde94fb90a01ea2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/1e903d070f51485fb228e018c1e416d6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/d23d48f9f8694005b1ee8dc2cc93905e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp, totalSize=50.4 K 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 96fd015cb2534969b459c5db9f14107a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fc88e632a8d14908bfc148e50e415e2d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 60da48c319a24d57aa84c9f54abeac64, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 8c36e4e19e9c462aba26af853ea8d6d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 63466131395f49a7b8e428f7b6854ad3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting cc751b7daa864ff290d82189bdbecda7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 0e4d5fe0f7e94977bdde94fb90a01ea2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1e903d070f51485fb228e018c1e416d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d23d48f9f8694005b1ee8dc2cc93905e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 23:54:27,329 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fe63b4222256457ca9c91bde13b85854_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 23:54:27,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:27,331 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:27,333 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286e1480af1c9b4f3b81ae7e98bcad3326 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512286e1480af1c9b4f3b81ae7e98bcad3326 2023-10-29 23:54:27,334 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231826aae96d5414859b4d6f288e714c160 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231826aae96d5414859b4d6f288e714c160 2023-10-29 23:54:27,336 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010100dc1aef8cc64965a3a4978279aea865 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010100dc1aef8cc64965a3a4978279aea865 2023-10-29 23:54:27,337 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e042603e0c0f426eac01df00cf81e4f1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103e042603e0c0f426eac01df00cf81e4f1 2023-10-29 23:54:27,337 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-10-29 23:54:27,337 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 23:54:27,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:27,355 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3be6f486f3c65a567087911fc90d6e4#family1#compaction#60 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:54:27,774 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/62931eebb6d743aabf6cfc22fb005028 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/62931eebb6d743aabf6cfc22fb005028 2023-10-29 23:54:27,781 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e3be6f486f3c65a567087911fc90d6e4/family1 of e3be6f486f3c65a567087911fc90d6e4 into 62931eebb6d743aabf6cfc22fb005028(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:54:27,781 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:27,781 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698623667328; duration=0sec 2023-10-29 23:54:27,782 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:27,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/96fd015cb2534969b459c5db9f14107a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fc88e632a8d14908bfc148e50e415e2d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/60da48c319a24d57aa84c9f54abeac64, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/8c36e4e19e9c462aba26af853ea8d6d1, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/63466131395f49a7b8e428f7b6854ad3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/cc751b7daa864ff290d82189bdbecda7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0e4d5fe0f7e94977bdde94fb90a01ea2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/1e903d070f51485fb228e018c1e416d6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/d23d48f9f8694005b1ee8dc2cc93905e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_] to archive 2023-10-29 23:54:27,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:27,820 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/96fd015cb2534969b459c5db9f14107a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/96fd015cb2534969b459c5db9f14107a 2023-10-29 23:54:27,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fc88e632a8d14908bfc148e50e415e2d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fc88e632a8d14908bfc148e50e415e2d 2023-10-29 23:54:27,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/60da48c319a24d57aa84c9f54abeac64 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/60da48c319a24d57aa84c9f54abeac64 2023-10-29 23:54:27,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/8c36e4e19e9c462aba26af853ea8d6d1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/8c36e4e19e9c462aba26af853ea8d6d1 2023-10-29 23:54:27,824 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/63466131395f49a7b8e428f7b6854ad3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/63466131395f49a7b8e428f7b6854ad3 2023-10-29 23:54:27,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/cc751b7daa864ff290d82189bdbecda7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/cc751b7daa864ff290d82189bdbecda7 2023-10-29 23:54:27,827 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0e4d5fe0f7e94977bdde94fb90a01ea2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0e4d5fe0f7e94977bdde94fb90a01ea2 2023-10-29 23:54:27,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/1e903d070f51485fb228e018c1e416d6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/1e903d070f51485fb228e018c1e416d6 2023-10-29 23:54:27,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/d23d48f9f8694005b1ee8dc2cc93905e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/d23d48f9f8694005b1ee8dc2cc93905e 2023-10-29 23:54:27,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/fe63b4222256457ca9c91bde13b85854_SeqId_44_ 2023-10-29 23:54:28,183 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e6b409d6a4f74775aee2b927d6fda507 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205e6b409d6a4f74775aee2b927d6fda507 2023-10-29 23:54:28,184 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:28,208 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19707e2bf899485f8757af2497456de5 first=Optional[r00] last=Optional[r2] 2023-10-29 23:54:28,209 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19707e2bf899485f8757af2497456de5}] 2023-10-29 23:54:28,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19707e2bf899485f8757af2497456de5 for inclusion in e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 23:54:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:28,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/19707e2bf899485f8757af2497456de5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__b250cjabco0e7pftkqvb5u6nl12iekdtle0v6jtccek2nd8bdh9pv7snqnqg7h18/family1/19707e2bf899485f8757af2497456de5 2023-10-29 23:54:28,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__b250cjabco0e7pftkqvb5u6nl12iekdtle0v6jtccek2nd8bdh9pv7snqnqg7h18/family1/19707e2bf899485f8757af2497456de5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_ 2023-10-29 23:54:28,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__b250cjabco0e7pftkqvb5u6nl12iekdtle0v6jtccek2nd8bdh9pv7snqnqg7h18/family1/19707e2bf899485f8757af2497456de5 into e3be6f486f3c65a567087911fc90d6e4/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_ - updating store file list. 2023-10-29 23:54:28,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_ into e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:28,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__b250cjabco0e7pftkqvb5u6nl12iekdtle0v6jtccek2nd8bdh9pv7snqnqg7h18/family1/19707e2bf899485f8757af2497456de5 into e3be6f486f3c65a567087911fc90d6e4/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_) 2023-10-29 23:54:28,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__b250cjabco0e7pftkqvb5u6nl12iekdtle0v6jtccek2nd8bdh9pv7snqnqg7h18/family1/19707e2bf899485f8757af2497456de5 2023-10-29 23:54:28,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 23:54:28,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 23:54:28,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): e3be6f486f3c65a567087911fc90d6e4/family1 is initiating minor compaction (all files) 2023-10-29 23:54:28,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6cbec288; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:28,223 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e3be6f486f3c65a567087911fc90d6e4/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:28,224 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d515b1c22ed42289e343e0958e32c11, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/62931eebb6d743aabf6cfc22fb005028, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp, totalSize=390.1 K 2023-10-29 23:54:28,224 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 3d515b1c22ed42289e343e0958e32c11, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823369 2023-10-29 23:54:28,224 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 62931eebb6d743aabf6cfc22fb005028, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223369 2023-10-29 23:54:28,225 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting b224e34eebc44de4bc6946e14b1168fb_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823369 2023-10-29 23:54:28,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:28,226 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:28,227 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c207b2dc1f334e47b46e7d92b8eb2e4a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c207b2dc1f334e47b46e7d92b8eb2e4a 2023-10-29 23:54:28,229 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e1dae9e6c1034caf86a3dd70790a187f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201e1dae9e6c1034caf86a3dd70790a187f 2023-10-29 23:54:28,230 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc60c58a7a5541e5a1dcc0cb4d77d3a9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc60c58a7a5541e5a1dcc0cb4d77d3a9 2023-10-29 23:54:28,230 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-10-29 23:54:28,230 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 23:54:28,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:28,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:28,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:28,232 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:28,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8090 sec 2023-10-29 23:54:28,243 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3be6f486f3c65a567087911fc90d6e4#family1#compaction#61 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:54:28,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 23:54:28,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:28,710 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 23:54:28,711 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-29 23:54:28,711 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 23:54:28,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-29 23:54:28,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE}] 2023-10-29 23:54:28,716 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE 2023-10-29 23:54:28,716 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:28,716 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623668716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623668716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623668716"}]},"ts":"1698623668716"} 2023-10-29 23:54:28,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:28,869 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:28,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:28,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e3be6f486f3c65a567087911fc90d6e4, disabling compactions & flushes 2023-10-29 23:54:28,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,062 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/.tmp/family1/3d6fd9c89dec444b96667a2ea98f5d8c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d6fd9c89dec444b96667a2ea98f5d8c 2023-10-29 23:54:29,067 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e3be6f486f3c65a567087911fc90d6e4/family1 of e3be6f486f3c65a567087911fc90d6e4 into 3d6fd9c89dec444b96667a2ea98f5d8c(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:54:29,067 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:29,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. after waiting 0 ms 2023-10-29 23:54:29,067 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698623668223; duration=0sec 2023-10-29 23:54:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,067 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:29,068 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d515b1c22ed42289e343e0958e32c11, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/62931eebb6d743aabf6cfc22fb005028, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_] to archive 2023-10-29 23:54:29,069 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:29,071 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d515b1c22ed42289e343e0958e32c11 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d515b1c22ed42289e343e0958e32c11 2023-10-29 23:54:29,072 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/62931eebb6d743aabf6cfc22fb005028 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/62931eebb6d743aabf6cfc22fb005028 2023-10-29 23:54:29,073 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/b224e34eebc44de4bc6946e14b1168fb_SeqId_47_ 2023-10-29 23:54:29,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 23:54:29,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:29,079 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e3be6f486f3c65a567087911fc90d6e4 to self. 2023-10-29 23:54:29,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,081 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=CLOSED 2023-10-29 23:54:29,081 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623669081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623669081"}]},"ts":"1698623669081"} 2023-10-29 23:54:29,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-10-29 23:54:29,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827 in 364 msec 2023-10-29 23:54:29,084 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=true 2023-10-29 23:54:29,235 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:29,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623669235"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623669235"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623669235"}]},"ts":"1698623669235"} 2023-10-29 23:54:29,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:29,388 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:29,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3be6f486f3c65a567087911fc90d6e4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,392 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,393 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:29,393 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:29,393 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3be6f486f3c65a567087911fc90d6e4 columnFamilyName family1 2023-10-29 23:54:29,398 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d6fd9c89dec444b96667a2ea98f5d8c 2023-10-29 23:54:29,398 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(310): Store=e3be6f486f3c65a567087911fc90d6e4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:29,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:29,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e3be6f486f3c65a567087911fc90d6e4; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65733579, jitterRate=-0.020493343472480774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:29,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:29,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., pid=47, masterSystemTime=1698623669388 2023-10-29 23:54:29,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:29,405 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:29,405 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623669405"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623669405"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623669405"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623669405"}]},"ts":"1698623669405"} 2023-10-29 23:54:29,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-10-29 23:54:29,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827 in 170 msec 2023-10-29 23:54:29,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-29 23:54:29,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE in 693 msec 2023-10-29 23:54:29,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-10-29 23:54:29,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 696 msec 2023-10-29 23:54:29,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1100 sec 2023-10-29 23:54:29,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-10-29 23:54:29,414 INFO [Listener at localhost/45261] compactions.TestMobCompactor(278): alter status finished 2023-10-29 23:54:29,414 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:29,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:29,416 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:29,417 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624269417 2023-10-29 23:54:29,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:29,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 23:54:29,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:29,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x11b026e3 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:29,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1803838c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:29,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:29,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:29,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:29,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:29,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:30,249 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e8da1132015a40f3957dd2f6544014bf to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128e8da1132015a40f3957dd2f6544014bf 2023-10-29 23:54:30,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:30,263 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:54:30,264 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:54:30,271 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:54:30,273 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:54:30,281 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b85d35044c6f4ad284ec7aa6569e4c4b first=Optional[r05] last=Optional[r8] 2023-10-29 23:54:30,281 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b85d35044c6f4ad284ec7aa6569e4c4b}] 2023-10-29 23:54:30,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b85d35044c6f4ad284ec7aa6569e4c4b for inclusion in e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:30,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 23:54:30,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:30,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:30,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b85d35044c6f4ad284ec7aa6569e4c4b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v09rl65ptgt833ti94qhfdvi4cecr9k2s0uqgo0pkgau7ggmio03ra9aibla4521/family1/b85d35044c6f4ad284ec7aa6569e4c4b 2023-10-29 23:54:30,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v09rl65ptgt833ti94qhfdvi4cecr9k2s0uqgo0pkgau7ggmio03ra9aibla4521/family1/b85d35044c6f4ad284ec7aa6569e4c4b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0d8b830873cc4a7cbfe764d511000c49_SeqId_53_ 2023-10-29 23:54:30,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v09rl65ptgt833ti94qhfdvi4cecr9k2s0uqgo0pkgau7ggmio03ra9aibla4521/family1/b85d35044c6f4ad284ec7aa6569e4c4b into e3be6f486f3c65a567087911fc90d6e4/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0d8b830873cc4a7cbfe764d511000c49_SeqId_53_ - updating store file list. 2023-10-29 23:54:30,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0d8b830873cc4a7cbfe764d511000c49_SeqId_53_ into e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:30,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v09rl65ptgt833ti94qhfdvi4cecr9k2s0uqgo0pkgau7ggmio03ra9aibla4521/family1/b85d35044c6f4ad284ec7aa6569e4c4b into e3be6f486f3c65a567087911fc90d6e4/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0d8b830873cc4a7cbfe764d511000c49_SeqId_53_) 2023-10-29 23:54:30,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v09rl65ptgt833ti94qhfdvi4cecr9k2s0uqgo0pkgau7ggmio03ra9aibla4521/family1/b85d35044c6f4ad284ec7aa6569e4c4b 2023-10-29 23:54:30,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:30,299 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:30,300 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120d60a7d5578924b26ba76be57f876a5c0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120d60a7d5578924b26ba76be57f876a5c0 2023-10-29 23:54:30,301 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b53f19b4bf6e4c82afc8e19c0567e024 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b53f19b4bf6e4c82afc8e19c0567e024 2023-10-29 23:54:30,301 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-10-29 23:54:30,301 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 23:54:30,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:30,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:30,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:30,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:30,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:30,302 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:30,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 887 msec 2023-10-29 23:54:30,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 23:54:30,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:30,764 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-29 23:54:30,765 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 23:54:30,765 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-29 23:54:30,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-29 23:54:30,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE}] 2023-10-29 23:54:30,771 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE 2023-10-29 23:54:30,772 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:30,772 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623670772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623670772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623670772"}]},"ts":"1698623670772"} 2023-10-29 23:54:30,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:30,924 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:30,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:30,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e3be6f486f3c65a567087911fc90d6e4, disabling compactions & flushes 2023-10-29 23:54:30,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:30,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:30,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. after waiting 0 ms 2023-10-29 23:54:30,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:30,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 23:54:30,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:30,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:30,931 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: e3be6f486f3c65a567087911fc90d6e4 to self. 2023-10-29 23:54:30,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:30,933 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=CLOSED 2023-10-29 23:54:30,933 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623670933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623670933"}]},"ts":"1698623670933"} 2023-10-29 23:54:30,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-29 23:54:30,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827 in 161 msec 2023-10-29 23:54:30,936 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=true 2023-10-29 23:54:31,086 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:31,086 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623671086"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623671086"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623671086"}]},"ts":"1698623671086"} 2023-10-29 23:54:31,087 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:31,239 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:31,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:31,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3be6f486f3c65a567087911fc90d6e4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:31,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:31,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:31,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:31,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:31,243 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:31,244 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:31,244 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1 2023-10-29 23:54:31,244 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3be6f486f3c65a567087911fc90d6e4 columnFamilyName family1 2023-10-29 23:54:31,249 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/0d8b830873cc4a7cbfe764d511000c49_SeqId_53_ 2023-10-29 23:54:31,252 DEBUG [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/family1/3d6fd9c89dec444b96667a2ea98f5d8c 2023-10-29 23:54:31,252 INFO [StoreOpener-e3be6f486f3c65a567087911fc90d6e4-1] regionserver.HStore(310): Store=e3be6f486f3c65a567087911fc90d6e4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:31,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:31,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:31,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:54:31,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e3be6f486f3c65a567087911fc90d6e4; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60503065, jitterRate=-0.09843407571315765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:31,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:54:31,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4., pid=53, masterSystemTime=1698623671239 2023-10-29 23:54:31,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:31,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:54:31,260 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3be6f486f3c65a567087911fc90d6e4, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:31,260 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698623671260"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623671260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623671260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623671260"}]},"ts":"1698623671260"} 2023-10-29 23:54:31,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-29 23:54:31,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure e3be6f486f3c65a567087911fc90d6e4, server=jenkins-hbase4.apache.org,40533,1698623599827 in 174 msec 2023-10-29 23:54:31,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-10-29 23:54:31,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3be6f486f3c65a567087911fc90d6e4, REOPEN/MOVE in 492 msec 2023-10-29 23:54:31,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-10-29 23:54:31,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-10-29 23:54:31,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 910 msec 2023-10-29 23:54:31,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-10-29 23:54:31,268 INFO [Listener at localhost/45261] compactions.TestMobCompactor(278): alter status finished 2023-10-29 23:54:31,269 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 23:54:31,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:31,271 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:31,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:31,271 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624271271 2023-10-29 23:54:31,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:31,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 23:54:31,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:31,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x74d56015 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:31,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70ce92e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 23:54:31,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 23:54:31,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:31,278 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 23:54:31,279 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 8 msec 2023-10-29 23:54:31,327 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=250 (was 261), OpenFileDescriptor=631 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 187), ProcessCount=169 (was 169), AvailableMemoryMB=14274 (was 14293) 2023-10-29 23:54:31,337 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=250, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=169, AvailableMemoryMB=14273 2023-10-29 23:54:31,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 23:54:31,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:31,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:54:31,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-10-29 23:54:31,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:54:31,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 23:54:31,342 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:31,343 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed empty. 2023-10-29 23:54:31,343 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:31,343 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-10-29 23:54:31,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 23:54:31,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 23:54:31,751 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-29 23:54:31,753 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8cf1fecd38159dabaaf2730f99142bed, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:54:31,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 23:54:32,158 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:32,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 8cf1fecd38159dabaaf2730f99142bed, disabling compactions & flushes 2023-10-29 23:54:32,159 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:32,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:32,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. after waiting 0 ms 2023-10-29 23:54:32,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:32,159 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:32,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:32,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:54:32,162 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623672162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623672162"}]},"ts":"1698623672162"} 2023-10-29 23:54:32,163 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:54:32,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:54:32,164 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623672163"}]},"ts":"1698623672163"} 2023-10-29 23:54:32,164 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-10-29 23:54:32,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, ASSIGN}] 2023-10-29 23:54:32,170 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, ASSIGN 2023-10-29 23:54:32,170 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:54:32,321 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:32,321 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623672321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623672321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623672321"}]},"ts":"1698623672321"} 2023-10-29 23:54:32,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:32,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 23:54:32,474 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:32,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:32,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cf1fecd38159dabaaf2730f99142bed, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:32,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:32,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:32,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:32,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:32,479 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:32,480 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:32,480 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:32,480 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cf1fecd38159dabaaf2730f99142bed columnFamilyName family1 2023-10-29 23:54:32,481 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(310): Store=8cf1fecd38159dabaaf2730f99142bed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:32,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:32,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:32,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:32,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:54:32,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8cf1fecd38159dabaaf2730f99142bed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65395398, jitterRate=-0.025532633066177368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:32,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:32,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., pid=57, masterSystemTime=1698623672474 2023-10-29 23:54:32,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:32,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:32,490 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:32,490 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623672490"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623672490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623672490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623672490"}]},"ts":"1698623672490"} 2023-10-29 23:54:32,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-10-29 23:54:32,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827 in 168 msec 2023-10-29 23:54:32,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-10-29 23:54:32,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, ASSIGN in 325 msec 2023-10-29 23:54:32,495 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:54:32,495 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623672495"}]},"ts":"1698623672495"} 2023-10-29 23:54:32,496 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-10-29 23:54:32,498 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:54:32,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-10-29 23:54:33,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 23:54:33,446 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-10-29 23:54:33,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:33,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,468 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:33,468 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:33,468 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:33,468 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:33,468 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,468 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,470 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,470 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:33,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:33,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:33,470 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,470 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:33,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:33,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,471 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,471 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:33,471 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:33,471 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:33,472 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:33,472 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:33,472 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:33,472 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:33,473 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 23:54:33,490 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cebfba9105814fdb91102600b7f6ca69 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130cebfba9105814fdb91102600b7f6ca69 2023-10-29 23:54:33,672 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:33,893 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98 2023-10-29 23:54:33,898 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98 2023-10-29 23:54:33,902 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98, entries=1000, sequenceid=5, filesize=190.5 K 2023-10-29 23:54:33,903 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 430ms, sequenceid=5, compaction requested=false 2023-10-29 23:54:33,903 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:33,903 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:33,903 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:33,904 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:33,904 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,904 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:33,904 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:33,906 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,906 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:33,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:33,906 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,906 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:33,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:33,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:33,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:33,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:33,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@604d2790[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:33,908 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:33,908 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,909 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,909 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:33,909 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:33,909 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,909 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:33,909 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:33,910 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:33,910 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,910 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:33,911 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:33,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:33,913 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:33,913 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:33,913 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:33,913 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,913 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:33,914 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,914 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:33,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,915 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:33,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:33,915 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:33,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,916 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,927 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:33,927 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:33,927 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:33,927 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:33,927 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:33,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:33,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:33,927 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,928 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:33,928 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,928 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,928 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:33,928 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:33,928 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:33,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:33,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:34,028 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:34,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:34,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:34,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:34,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,034 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:34,034 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:34,034 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:34,034 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:34,035 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,035 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,036 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:34,036 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:34,036 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,036 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:34,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,037 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:34,037 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:34,037 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:34,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:34,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:34,038 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:34,038 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:34,038 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 23:54:34,451 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112807de4ab9482d44afb90a08ec400629bb to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112807de4ab9482d44afb90a08ec400629bb 2023-10-29 23:54:34,610 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:54:34,856 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/18fa93bee2254dd8905ce6b6023d82df 2023-10-29 23:54:34,861 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/18fa93bee2254dd8905ce6b6023d82df as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/18fa93bee2254dd8905ce6b6023d82df 2023-10-29 23:54:34,865 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/18fa93bee2254dd8905ce6b6023d82df, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 23:54:34,866 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 828ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:34,866 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:34,866 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:34,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:34,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:34,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:34,866 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:34,868 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,868 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:34,868 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,868 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:34,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:34,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24588e12[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:34,869 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:34,869 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,872 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:34,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:34,872 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:34,872 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,872 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:34,873 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,873 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:34,873 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:34,873 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:34,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:34,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:34,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:34,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:34,876 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:34,876 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:34,876 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:34,876 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,876 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:34,877 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,877 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:34,877 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:34,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:34,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:34,878 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:34,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,879 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:34,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,881 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,881 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:34,881 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,882 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,882 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:34,881 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:34,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:34,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 23:54:34,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:34,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:34,882 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:34,882 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,882 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,882 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,882 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:34,882 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:34,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:34,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:34,982 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:34,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:34,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:34,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:34,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,988 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:34,988 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:34,988 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:34,988 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:34,988 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,988 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,992 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,992 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:34,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:34,992 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:34,992 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:34,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,993 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,993 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:34,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:34,993 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:34,993 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:34,993 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:34,994 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:35,407 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120100026a0b9f494aeba06039127da022fa to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120100026a0b9f494aeba06039127da022fa 2023-10-29 23:54:35,813 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/1dae92c37a1949dd822a0746f732ac09 2023-10-29 23:54:35,818 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/1dae92c37a1949dd822a0746f732ac09 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1dae92c37a1949dd822a0746f732ac09 2023-10-29 23:54:35,821 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1dae92c37a1949dd822a0746f732ac09, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 23:54:35,822 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 828ms, sequenceid=13, compaction requested=true 2023-10-29 23:54:35,822 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:35,822 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:35,822 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:35,822 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:35,822 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,822 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:35,822 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:35,824 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,824 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:35,824 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,824 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:35,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:35,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:35,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e7edc90[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:35,825 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:35,826 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,833 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,833 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:35,833 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:35,833 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:35,833 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,833 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:35,834 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:35,834 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:35,834 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,834 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:35,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:35,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:35,836 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:35,837 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:35,837 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:35,837 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,837 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:35,838 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,838 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:35,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,838 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:35,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:35,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:35,839 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:35,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,840 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:35,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:35,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,842 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,842 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:35,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:35,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:35,942 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:35,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:35,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:35,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:35,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,948 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:35,948 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:35,948 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:35,948 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:35,949 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,949 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,951 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:35,951 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:35,951 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:35,951 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:35,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:35,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,952 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,952 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:35,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:35,952 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:35,952 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:35,953 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:36,367 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b0d5f0c74bda409abd263e189a7685fd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b0d5f0c74bda409abd263e189a7685fd 2023-10-29 23:54:36,772 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/5e60890da6a44b279c4fe5d12fd2316b 2023-10-29 23:54:36,778 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/5e60890da6a44b279c4fe5d12fd2316b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/5e60890da6a44b279c4fe5d12fd2316b 2023-10-29 23:54:36,782 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/5e60890da6a44b279c4fe5d12fd2316b, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 23:54:36,783 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 830ms, sequenceid=17, compaction requested=true 2023-10-29 23:54:36,783 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:36,783 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:36,783 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:36,783 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:36,785 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,785 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:36,786 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,786 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:36,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:36,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f15e1af[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:36,788 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:36,788 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,789 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,789 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:36,789 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:36,789 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:36,789 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,789 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:36,793 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:36,793 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:36,793 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,793 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:36,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:36,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:36,796 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:36,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:36,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:36,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,796 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:36,798 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,798 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:36,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,798 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:36,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,800 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:36,802 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:36,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:36,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:36,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,802 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,803 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:36,803 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:36,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 23:54:36,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:36,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:36,903 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:36,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:36,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:36,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:36,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,909 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:36,909 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:36,909 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:36,909 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:36,910 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,910 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,913 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:36,913 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:36,913 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:36,913 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:36,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:36,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,914 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:36,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:36,914 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:36,914 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:36,914 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:36,915 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:36,915 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:36,915 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:36,915 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:36,915 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:37,329 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286439bf43b43e4cffbcb7fe93b1eb3cb1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286439bf43b43e4cffbcb7fe93b1eb3cb1 2023-10-29 23:54:37,734 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/642994131f194a30818d2ea355166a64 2023-10-29 23:54:37,739 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/642994131f194a30818d2ea355166a64 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/642994131f194a30818d2ea355166a64 2023-10-29 23:54:37,742 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/642994131f194a30818d2ea355166a64, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 23:54:37,743 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 828ms, sequenceid=21, compaction requested=true 2023-10-29 23:54:37,743 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:37,743 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:37,743 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,745 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,745 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:37,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:37,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66ed3a7a[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:37,746 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:37,747 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,748 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,748 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:37,748 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:37,748 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:37,748 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,748 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:37,750 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,750 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:37,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:37,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:37,752 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:37,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:37,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:37,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,752 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:37,754 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,754 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:37,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,754 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:37,754 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,755 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,757 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,757 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:37,757 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,757 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:37,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:37,757 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:37,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:37,757 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:37,758 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:37,758 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,758 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,758 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:37,758 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:37,758 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:37,858 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:37,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:37,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:37,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:37,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,864 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:37,864 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:37,864 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:37,864 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:37,864 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,864 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,865 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:37,865 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:37,866 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:37,866 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:37,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,867 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,867 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:37,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:37,867 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:37,867 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:37,867 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:37,867 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:37,867 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:37,867 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:37,867 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:37,867 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:38,279 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a736fdfed42e470b953f117430edde47 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a736fdfed42e470b953f117430edde47 2023-10-29 23:54:38,684 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9 2023-10-29 23:54:38,688 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9 2023-10-29 23:54:38,693 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 23:54:38,693 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 826ms, sequenceid=25, compaction requested=true 2023-10-29 23:54:38,693 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:38,694 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:38,694 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:38,694 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:38,694 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,694 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:38,694 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,695 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:38,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62510ab[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:38,697 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:38,697 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,698 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,718 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,718 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:38,718 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:38,718 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:38,719 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:38,719 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11b026e3 to 127.0.0.1:50259 2023-10-29 23:54:38,719 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:38,719 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74d56015 to 127.0.0.1:50259 2023-10-29 23:54:38,719 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:38,719 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:38,719 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30eb4b57 to 127.0.0.1:50259 2023-10-29 23:54:38,719 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:38,719 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:38,720 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x144338f0 to 127.0.0.1:50259 2023-10-29 23:54:38,720 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:38,720 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:54:38,720 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c771da2 to 127.0.0.1:50259 2023-10-29 23:54:38,720 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:54:38,722 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:38,722 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:38,722 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,722 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:38,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:38,725 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:38,725 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:38,725 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:38,725 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,725 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:38,726 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,726 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:38,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,727 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:38,727 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,728 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,734 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,734 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:38,734 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:38,734 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:38,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:38,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:38,734 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,734 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:38,735 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,735 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,735 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,735 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,735 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:38,735 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:38,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:38,835 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:38,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:38,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,841 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:38,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:38,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:38,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:38,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,845 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,845 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:38,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:38,845 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:38,845 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,846 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:38,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:38,847 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:38,847 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:38,847 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:38,847 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:38,847 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:38,847 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:38,847 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:38,847 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:39,259 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010195e6da5f3efd47c992d743a49c1120d7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010195e6da5f3efd47c992d743a49c1120d7 2023-10-29 23:54:39,665 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3 2023-10-29 23:54:39,670 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3 2023-10-29 23:54:39,674 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 23:54:39,675 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 828ms, sequenceid=29, compaction requested=true 2023-10-29 23:54:39,675 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:39,675 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:39,675 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:39,675 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:39,675 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,677 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:39,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:39,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:39,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ee7d6a3[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:39,679 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:39,679 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,680 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,680 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:39,680 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:39,680 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:39,680 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,680 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:39,682 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:39,682 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,682 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:39,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:39,682 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:39,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:39,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:39,684 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:39,684 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:39,684 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:39,684 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,685 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:39,686 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,686 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:39,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,686 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:39,686 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,687 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:39,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:39,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:39,689 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,689 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:39,690 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 23:54:39,690 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:39,690 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:39,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:39,790 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:39,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:39,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:39,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:39,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,796 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:39,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:39,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:39,796 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:39,797 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,797 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,798 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:39,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:39,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:39,798 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:39,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:39,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,799 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:39,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:39,799 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:39,799 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:39,800 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:39,809 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:39,809 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:39,809 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:39,809 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:39,809 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:40,226 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103018a7ffa6a174b158850085413e27898 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103018a7ffa6a174b158850085413e27898 2023-10-29 23:54:40,632 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2 2023-10-29 23:54:40,637 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2 2023-10-29 23:54:40,640 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 23:54:40,641 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 832ms, sequenceid=33, compaction requested=true 2023-10-29 23:54:40,641 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:40,641 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:40,641 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:40,641 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:40,641 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,641 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:40,641 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:40,644 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,644 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:40,644 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,644 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:40,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:40,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e3f5c49[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:40,645 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:40,645 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,646 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,646 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:40,647 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:40,647 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:40,647 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,647 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:40,648 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,648 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:40,648 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:40,648 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:40,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:40,650 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:40,650 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:40,650 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:40,650 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,650 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:40,651 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,651 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:40,651 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:40,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:40,652 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:40,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:40,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:40,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,653 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:40,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,655 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:40,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:40,655 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:40,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:40,656 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 23:54:40,656 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:40,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:40,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:40,656 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,656 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:40,656 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:40,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:40,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:40,756 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:40,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:40,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:40,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:40,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,762 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:40,762 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:40,762 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:40,762 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:40,763 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,763 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,764 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:40,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:40,764 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,764 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:40,764 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:40,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:40,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,765 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:40,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:40,765 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:40,765 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:40,765 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:40,765 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:41,177 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ff30c3710287448aacc5a7be84d7fa0a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907ff30c3710287448aacc5a7be84d7fa0a 2023-10-29 23:54:41,183 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/1fa3a297a3b14dadbff288590f087f45 2023-10-29 23:54:41,187 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/1fa3a297a3b14dadbff288590f087f45 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1fa3a297a3b14dadbff288590f087f45 2023-10-29 23:54:41,190 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1fa3a297a3b14dadbff288590f087f45, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 23:54:41,191 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 426ms, sequenceid=37, compaction requested=true 2023-10-29 23:54:41,191 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:41,191 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:41,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:41,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:41,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:41,191 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:41,192 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,192 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:41,193 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,193 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:41,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:41,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@118e9b1e[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:41,194 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:41,194 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,196 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,197 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:41,197 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:41,197 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:41,197 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,197 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:41,198 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,198 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:41,198 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:41,198 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:41,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:41,200 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:41,200 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:41,200 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:41,200 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,200 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:41,201 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,201 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:41,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,201 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:41,202 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,203 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,204 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,204 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:41,204 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:41,205 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:41,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 23:54:41,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:41,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:41,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:41,205 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:41,305 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:41,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:41,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:41,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:41,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,311 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:41,311 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:41,311 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 23:54:41,311 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 23:54:41,311 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,311 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,314 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:41,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:41,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:41,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:41,314 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:41,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,315 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 23:54:41,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 23:54:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 23:54:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:54:41,315 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:41,315 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:41,315 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. started... 2023-10-29 23:54:41,315 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8cf1fecd38159dabaaf2730f99142bed 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:54:41,727 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112020f97463bed8428e8d40c798c1c7210e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112020f97463bed8428e8d40c798c1c7210e 2023-10-29 23:54:42,132 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/fab3ad92076b4955adebdba810c64b09 2023-10-29 23:54:42,136 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/fab3ad92076b4955adebdba810c64b09 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/fab3ad92076b4955adebdba810c64b09 2023-10-29 23:54:42,139 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/fab3ad92076b4955adebdba810c64b09, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 23:54:42,140 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8cf1fecd38159dabaaf2730f99142bed in 825ms, sequenceid=41, compaction requested=true 2023-10-29 23:54:42,140 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:42,140 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:54:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:54:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 23:54:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 23:54:42,142 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,142 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:42,142 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,142 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:42,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 23:54:42,143 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 23:54:42,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f0071cc[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:42,144 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,145 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,145 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 23:54:42,145 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 23:54:42,145 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:42,145 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,145 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:42,146 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 23:54:42,146 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,146 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:42,146 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 23:54:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:42,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 23:54:42,148 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 23:54:42,148 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:42,148 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:42,148 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,148 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:42,150 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,150 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,150 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:42,151 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:42,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,152 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:42,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:42,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 23:54:42,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:42,154 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:42,154 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:42,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:42,254 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:42,256 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:42,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:42,258 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:42,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:42,259 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624282259 2023-10-29 23:54:42,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:42,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 23:54:42,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:42,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x5a395a74 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:42,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c50232a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:42,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,111 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035de99c8467c749c9b475b6d4679be669 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035de99c8467c749c9b475b6d4679be669 2023-10-29 23:54:43,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:43,125 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:54:43,126 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:54:43,132 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:54:43,133 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:54:43,140 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/13eb8878bb724262a716df7007f1a19f first=Optional[r3] last=Optional[r6] 2023-10-29 23:54:43,140 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/13eb8878bb724262a716df7007f1a19f}] 2023-10-29 23:54:43,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/13eb8878bb724262a716df7007f1a19f for inclusion in 8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:43,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 23:54:43,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:43,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:43,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/13eb8878bb724262a716df7007f1a19f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pjegefofjp10i30hdmqcbo7v5j9cb48jcc9mvq3d6htf8j3ak1b7d4c8u6hpufhl/family1/13eb8878bb724262a716df7007f1a19f 2023-10-29 23:54:43,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pjegefofjp10i30hdmqcbo7v5j9cb48jcc9mvq3d6htf8j3ak1b7d4c8u6hpufhl/family1/13eb8878bb724262a716df7007f1a19f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_ 2023-10-29 23:54:43,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pjegefofjp10i30hdmqcbo7v5j9cb48jcc9mvq3d6htf8j3ak1b7d4c8u6hpufhl/family1/13eb8878bb724262a716df7007f1a19f into 8cf1fecd38159dabaaf2730f99142bed/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_ - updating store file list. 2023-10-29 23:54:43,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_ into 8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:43,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pjegefofjp10i30hdmqcbo7v5j9cb48jcc9mvq3d6htf8j3ak1b7d4c8u6hpufhl/family1/13eb8878bb724262a716df7007f1a19f into 8cf1fecd38159dabaaf2730f99142bed/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_) 2023-10-29 23:54:43,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pjegefofjp10i30hdmqcbo7v5j9cb48jcc9mvq3d6htf8j3ak1b7d4c8u6hpufhl/family1/13eb8878bb724262a716df7007f1a19f 2023-10-29 23:54:43,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 23:54:43,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 23:54:43,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 8cf1fecd38159dabaaf2730f99142bed/family1 is initiating minor compaction 2023-10-29 23:54:43,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30bd779e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:43,156 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8cf1fecd38159dabaaf2730f99142bed/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:43,156 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/18fa93bee2254dd8905ce6b6023d82df, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1dae92c37a1949dd822a0746f732ac09, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/5e60890da6a44b279c4fe5d12fd2316b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/642994131f194a30818d2ea355166a64, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1fa3a297a3b14dadbff288590f087f45, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/fab3ad92076b4955adebdba810c64b09, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp, totalSize=50.3 K 2023-10-29 23:54:43,156 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 18fa93bee2254dd8905ce6b6023d82df, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:54:43,156 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1dae92c37a1949dd822a0746f732ac09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:54:43,156 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 5e60890da6a44b279c4fe5d12fd2316b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 23:54:43,156 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 642994131f194a30818d2ea355166a64, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 23:54:43,157 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 3f0b71714b4044d2bc14ca1bd9f6c5b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 23:54:43,157 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d3f1e1b4a9a84f2ea88477f3a7300fd3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 23:54:43,157 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting f4ec60d8d7bf427cbe47e7622bd3b9c2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 23:54:43,157 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1fa3a297a3b14dadbff288590f087f45, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 23:54:43,157 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fab3ad92076b4955adebdba810c64b09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 23:54:43,157 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting e05f3a699f0b4caa9df461556152ce57_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 23:54:43,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:43,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:43,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286439bf43b43e4cffbcb7fe93b1eb3cb1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286439bf43b43e4cffbcb7fe93b1eb3cb1 2023-10-29 23:54:43,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a736fdfed42e470b953f117430edde47 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a736fdfed42e470b953f117430edde47 2023-10-29 23:54:43,163 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010195e6da5f3efd47c992d743a49c1120d7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010195e6da5f3efd47c992d743a49c1120d7 2023-10-29 23:54:43,164 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103018a7ffa6a174b158850085413e27898 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103018a7ffa6a174b158850085413e27898 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-10-29 23:54:43,164 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:43,197 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8cf1fecd38159dabaaf2730f99142bed#family1#compaction#72 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:54:44,017 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/1ee8abb652714d8a9b491cff19c8ee8f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1ee8abb652714d8a9b491cff19c8ee8f 2023-10-29 23:54:44,020 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cdd3dc1d4d2049d59b9170c377726e4a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205cdd3dc1d4d2049d59b9170c377726e4a 2023-10-29 23:54:44,020 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:44,022 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8cf1fecd38159dabaaf2730f99142bed/family1 of 8cf1fecd38159dabaaf2730f99142bed into 1ee8abb652714d8a9b491cff19c8ee8f(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:54:44,022 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:44,022 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698623683156; duration=0sec 2023-10-29 23:54:44,022 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:44,042 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 first=Optional[r00] last=Optional[r2] 2023-10-29 23:54:44,043 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2}] 2023-10-29 23:54:44,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 for inclusion in 8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:44,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 23:54:44,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:44,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:44,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpnosotrlqpjcu45c2sgrk8r6t3enagsgrf787lobjrlbdpd3c3d0181lhrkhhqj/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 2023-10-29 23:54:44,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpnosotrlqpjcu45c2sgrk8r6t3enagsgrf787lobjrlbdpd3c3d0181lhrkhhqj/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_ 2023-10-29 23:54:44,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpnosotrlqpjcu45c2sgrk8r6t3enagsgrf787lobjrlbdpd3c3d0181lhrkhhqj/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 into 8cf1fecd38159dabaaf2730f99142bed/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_ - updating store file list. 2023-10-29 23:54:44,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_ into 8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:44,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpnosotrlqpjcu45c2sgrk8r6t3enagsgrf787lobjrlbdpd3c3d0181lhrkhhqj/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 into 8cf1fecd38159dabaaf2730f99142bed/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_) 2023-10-29 23:54:44,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpnosotrlqpjcu45c2sgrk8r6t3enagsgrf787lobjrlbdpd3c3d0181lhrkhhqj/family1/6cb1d2ff8baa4c7f8137037c5f0f5db2 2023-10-29 23:54:44,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 23:54:44,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 23:54:44,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 8cf1fecd38159dabaaf2730f99142bed/family1 is initiating minor compaction (all files) 2023-10-29 23:54:44,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f7dc06f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:44,055 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8cf1fecd38159dabaaf2730f99142bed/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:44,055 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1ee8abb652714d8a9b491cff19c8ee8f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp, totalSize=388.1 K 2023-10-29 23:54:44,055 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 2d1caf6ec3554b61bd45f8ea1ee2ce98, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823369 2023-10-29 23:54:44,056 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1ee8abb652714d8a9b491cff19c8ee8f, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223369 2023-10-29 23:54:44,056 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 85e6c122173f42cfb5be24a859ff7abd_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823369 2023-10-29 23:54:44,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:44,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:44,059 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130cebfba9105814fdb91102600b7f6ca69 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130cebfba9105814fdb91102600b7f6ca69 2023-10-29 23:54:44,060 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120100026a0b9f494aeba06039127da022fa to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120100026a0b9f494aeba06039127da022fa 2023-10-29 23:54:44,061 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b0d5f0c74bda409abd263e189a7685fd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205b0d5f0c74bda409abd263e189a7685fd 2023-10-29 23:54:44,061 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-10-29 23:54:44,061 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 23:54:44,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:44,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:44,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:44,062 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:44,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8050 sec 2023-10-29 23:54:44,069 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8cf1fecd38159dabaaf2730f99142bed#family1#compaction#73 average throughput is 35.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:54:44,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/18fa93bee2254dd8905ce6b6023d82df, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1dae92c37a1949dd822a0746f732ac09, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/5e60890da6a44b279c4fe5d12fd2316b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/642994131f194a30818d2ea355166a64, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1fa3a297a3b14dadbff288590f087f45, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/fab3ad92076b4955adebdba810c64b09, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_] to archive 2023-10-29 23:54:44,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:44,126 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/18fa93bee2254dd8905ce6b6023d82df to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/18fa93bee2254dd8905ce6b6023d82df 2023-10-29 23:54:44,127 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1dae92c37a1949dd822a0746f732ac09 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1dae92c37a1949dd822a0746f732ac09 2023-10-29 23:54:44,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/5e60890da6a44b279c4fe5d12fd2316b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/5e60890da6a44b279c4fe5d12fd2316b 2023-10-29 23:54:44,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/642994131f194a30818d2ea355166a64 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/642994131f194a30818d2ea355166a64 2023-10-29 23:54:44,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/3f0b71714b4044d2bc14ca1bd9f6c5b9 2023-10-29 23:54:44,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/d3f1e1b4a9a84f2ea88477f3a7300fd3 2023-10-29 23:54:44,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/f4ec60d8d7bf427cbe47e7622bd3b9c2 2023-10-29 23:54:44,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1fa3a297a3b14dadbff288590f087f45 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1fa3a297a3b14dadbff288590f087f45 2023-10-29 23:54:44,137 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/fab3ad92076b4955adebdba810c64b09 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/fab3ad92076b4955adebdba810c64b09 2023-10-29 23:54:44,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/e05f3a699f0b4caa9df461556152ce57_SeqId_44_ 2023-10-29 23:54:44,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 23:54:44,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:44,550 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 23:54:44,551 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-29 23:54:44,551 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 23:54:44,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-29 23:54:44,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE}] 2023-10-29 23:54:44,555 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE 2023-10-29 23:54:44,556 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:44,556 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623684556"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623684556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623684556"}]},"ts":"1698623684556"} 2023-10-29 23:54:44,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:44,709 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:44,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:44,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8cf1fecd38159dabaaf2730f99142bed, disabling compactions & flushes 2023-10-29 23:54:44,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,285 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/.tmp/family1/563c8b0aad854b1596251b24b2539142 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/563c8b0aad854b1596251b24b2539142 2023-10-29 23:54:45,289 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8cf1fecd38159dabaaf2730f99142bed/family1 of 8cf1fecd38159dabaaf2730f99142bed into 563c8b0aad854b1596251b24b2539142(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:54:45,289 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:45,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,290 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698623684055; duration=1sec 2023-10-29 23:54:45,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. after waiting 0 ms 2023-10-29 23:54:45,290 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:45,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,293 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1ee8abb652714d8a9b491cff19c8ee8f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_] to archive 2023-10-29 23:54:45,293 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:45,295 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/2d1caf6ec3554b61bd45f8ea1ee2ce98 2023-10-29 23:54:45,296 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1ee8abb652714d8a9b491cff19c8ee8f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/1ee8abb652714d8a9b491cff19c8ee8f 2023-10-29 23:54:45,297 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/85e6c122173f42cfb5be24a859ff7abd_SeqId_47_ 2023-10-29 23:54:45,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 23:54:45,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:45,302 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 8cf1fecd38159dabaaf2730f99142bed to self. 2023-10-29 23:54:45,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,303 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=CLOSED 2023-10-29 23:54:45,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623685303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623685303"}]},"ts":"1698623685303"} 2023-10-29 23:54:45,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-10-29 23:54:45,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827 in 748 msec 2023-10-29 23:54:45,306 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=true 2023-10-29 23:54:45,457 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:45,457 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623685457"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623685457"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623685457"}]},"ts":"1698623685457"} 2023-10-29 23:54:45,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:45,610 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:45,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cf1fecd38159dabaaf2730f99142bed, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:45,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:45,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,614 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,615 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:45,615 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:45,615 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cf1fecd38159dabaaf2730f99142bed columnFamilyName family1 2023-10-29 23:54:45,620 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/563c8b0aad854b1596251b24b2539142 2023-10-29 23:54:45,620 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(310): Store=8cf1fecd38159dabaaf2730f99142bed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:45,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:45,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8cf1fecd38159dabaaf2730f99142bed; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65067510, jitterRate=-0.03041854500770569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:45,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:45,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., pid=63, masterSystemTime=1698623685610 2023-10-29 23:54:45,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:45,627 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:45,628 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623685627"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623685627"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623685627"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623685627"}]},"ts":"1698623685627"} 2023-10-29 23:54:45,630 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-10-29 23:54:45,630 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827 in 171 msec 2023-10-29 23:54:45,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-10-29 23:54:45,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE in 1.0750 sec 2023-10-29 23:54:45,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-29 23:54:45,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0790 sec 2023-10-29 23:54:45,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4940 sec 2023-10-29 23:54:45,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-10-29 23:54:45,637 INFO [Listener at localhost/45261] compactions.TestMobCompactor(278): alter status finished 2023-10-29 23:54:45,638 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:45,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:45,640 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:45,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:45,640 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624285640 2023-10-29 23:54:45,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:45,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 23:54:45,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:45,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x465d09e7 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:45,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1982ae26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:45,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:45,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:45,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:45,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:45,648 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:46,474 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284bbc1ab6877e457fb939f9952f66e800 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284bbc1ab6877e457fb939f9952f66e800 2023-10-29 23:54:46,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:46,492 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:54:46,493 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:54:46,498 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:54:46,500 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:54:46,509 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/831802a71ebf43138ab06e9ce8c26df6 first=Optional[r05] last=Optional[r8] 2023-10-29 23:54:46,509 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/831802a71ebf43138ab06e9ce8c26df6}] 2023-10-29 23:54:46,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/831802a71ebf43138ab06e9ce8c26df6 for inclusion in 8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:46,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 23:54:46,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:46,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:46,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/831802a71ebf43138ab06e9ce8c26df6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hc2jr5nvrofphrk73p31vapq1nglu43oue4n5soi7p8cma9jebcp0l1970fnq46b/family1/831802a71ebf43138ab06e9ce8c26df6 2023-10-29 23:54:46,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hc2jr5nvrofphrk73p31vapq1nglu43oue4n5soi7p8cma9jebcp0l1970fnq46b/family1/831802a71ebf43138ab06e9ce8c26df6 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/cc5c8a13a4d14c2086473aa0d61bcc49_SeqId_53_ 2023-10-29 23:54:46,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hc2jr5nvrofphrk73p31vapq1nglu43oue4n5soi7p8cma9jebcp0l1970fnq46b/family1/831802a71ebf43138ab06e9ce8c26df6 into 8cf1fecd38159dabaaf2730f99142bed/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/cc5c8a13a4d14c2086473aa0d61bcc49_SeqId_53_ - updating store file list. 2023-10-29 23:54:46,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/cc5c8a13a4d14c2086473aa0d61bcc49_SeqId_53_ into 8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:46,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hc2jr5nvrofphrk73p31vapq1nglu43oue4n5soi7p8cma9jebcp0l1970fnq46b/family1/831802a71ebf43138ab06e9ce8c26df6 into 8cf1fecd38159dabaaf2730f99142bed/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/cc5c8a13a4d14c2086473aa0d61bcc49_SeqId_53_) 2023-10-29 23:54:46,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hc2jr5nvrofphrk73p31vapq1nglu43oue4n5soi7p8cma9jebcp0l1970fnq46b/family1/831802a71ebf43138ab06e9ce8c26df6 2023-10-29 23:54:46,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:46,526 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:46,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112020f97463bed8428e8d40c798c1c7210e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112020f97463bed8428e8d40c798c1c7210e 2023-10-29 23:54:46,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112807de4ab9482d44afb90a08ec400629bb to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112807de4ab9482d44afb90a08ec400629bb 2023-10-29 23:54:46,529 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-10-29 23:54:46,529 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 23:54:46,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:46,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:46,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:46,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:46,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:46,531 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:46,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 892 msec 2023-10-29 23:54:46,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-10-29 23:54:46,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:46,994 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-29 23:54:46,995 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 23:54:46,995 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-29 23:54:46,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-29 23:54:46,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE}] 2023-10-29 23:54:46,999 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE 2023-10-29 23:54:46,999 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:47,000 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623686999"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623686999"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623686999"}]},"ts":"1698623686999"} 2023-10-29 23:54:47,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:47,152 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:47,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8cf1fecd38159dabaaf2730f99142bed, disabling compactions & flushes 2023-10-29 23:54:47,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:47,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:47,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. after waiting 0 ms 2023-10-29 23:54:47,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:47,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 23:54:47,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:47,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:47,160 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 8cf1fecd38159dabaaf2730f99142bed to self. 2023-10-29 23:54:47,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,162 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=CLOSED 2023-10-29 23:54:47,162 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623687162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623687162"}]},"ts":"1698623687162"} 2023-10-29 23:54:47,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-10-29 23:54:47,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827 in 162 msec 2023-10-29 23:54:47,164 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=true 2023-10-29 23:54:47,315 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:47,315 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623687315"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623687315"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623687315"}]},"ts":"1698623687315"} 2023-10-29 23:54:47,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:47,468 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:47,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:47,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cf1fecd38159dabaaf2730f99142bed, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:47,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:47,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,472 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,472 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:47,472 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1 2023-10-29 23:54:47,473 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cf1fecd38159dabaaf2730f99142bed columnFamilyName family1 2023-10-29 23:54:47,477 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/563c8b0aad854b1596251b24b2539142 2023-10-29 23:54:47,480 DEBUG [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/family1/cc5c8a13a4d14c2086473aa0d61bcc49_SeqId_53_ 2023-10-29 23:54:47,480 INFO [StoreOpener-8cf1fecd38159dabaaf2730f99142bed-1] regionserver.HStore(310): Store=8cf1fecd38159dabaaf2730f99142bed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:47,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:54:47,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8cf1fecd38159dabaaf2730f99142bed; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72341836, jitterRate=0.07797735929489136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:47,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:54:47,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed., pid=69, masterSystemTime=1698623687468 2023-10-29 23:54:47,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:47,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:54:47,487 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8cf1fecd38159dabaaf2730f99142bed, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:47,487 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698623687487"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623687487"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623687487"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623687487"}]},"ts":"1698623687487"} 2023-10-29 23:54:47,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-29 23:54:47,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 8cf1fecd38159dabaaf2730f99142bed, server=jenkins-hbase4.apache.org,40533,1698623599827 in 173 msec 2023-10-29 23:54:47,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-29 23:54:47,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8cf1fecd38159dabaaf2730f99142bed, REOPEN/MOVE in 492 msec 2023-10-29 23:54:47,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-10-29 23:54:47,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 495 msec 2023-10-29 23:54:47,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 908 msec 2023-10-29 23:54:47,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-10-29 23:54:47,495 INFO [Listener at localhost/45261] compactions.TestMobCompactor(278): alter status finished 2023-10-29 23:54:47,496 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 23:54:47,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:47,498 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:47,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:47,498 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624287498 2023-10-29 23:54:47,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:54:47,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 23:54:47,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:47,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x27a51bbc to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:47,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28cf5b05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:47,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 23:54:47,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 23:54:47,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:47,505 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 23:54:47,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-10-29 23:54:47,550 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=246 (was 250), OpenFileDescriptor=626 (was 631), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 134) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=14211 (was 14273) 2023-10-29 23:54:47,561 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=246, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=169, AvailableMemoryMB=14211 2023-10-29 23:54:47,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 23:54:47,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:47,566 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:54:47,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-10-29 23:54:47,566 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:54:47,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 23:54:47,567 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:47,567 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68 empty. 2023-10-29 23:54:47,568 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:47,568 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-29 23:54:47,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 23:54:47,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 23:54:47,975 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-10-29 23:54:47,976 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 84f0cd25a9e945d1c6817d8697ffcb68, NAME => 'testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:54:48,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 23:54:48,382 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:48,382 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 84f0cd25a9e945d1c6817d8697ffcb68, disabling compactions & flushes 2023-10-29 23:54:48,382 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:48,382 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:48,382 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. after waiting 0 ms 2023-10-29 23:54:48,382 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:48,382 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:48,382 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 84f0cd25a9e945d1c6817d8697ffcb68: 2023-10-29 23:54:48,384 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:54:48,385 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698623688385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623688385"}]},"ts":"1698623688385"} 2023-10-29 23:54:48,386 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:54:48,387 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:54:48,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623688387"}]},"ts":"1698623688387"} 2023-10-29 23:54:48,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-10-29 23:54:48,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=84f0cd25a9e945d1c6817d8697ffcb68, ASSIGN}] 2023-10-29 23:54:48,393 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=84f0cd25a9e945d1c6817d8697ffcb68, ASSIGN 2023-10-29 23:54:48,393 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=84f0cd25a9e945d1c6817d8697ffcb68, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:54:48,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=84f0cd25a9e945d1c6817d8697ffcb68, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:48,544 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698623688544"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623688544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623688544"}]},"ts":"1698623688544"} 2023-10-29 23:54:48,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 84f0cd25a9e945d1c6817d8697ffcb68, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:48,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 23:54:48,696 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:48,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:48,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 84f0cd25a9e945d1c6817d8697ffcb68, NAME => 'testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:54:48,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-10-29 23:54:48,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-10-29 23:54:48,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:48,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:48,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:48,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:48,703 INFO [StoreOpener-84f0cd25a9e945d1c6817d8697ffcb68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:48,704 DEBUG [StoreOpener-84f0cd25a9e945d1c6817d8697ffcb68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1 2023-10-29 23:54:48,704 DEBUG [StoreOpener-84f0cd25a9e945d1c6817d8697ffcb68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1 2023-10-29 23:54:48,704 INFO [StoreOpener-84f0cd25a9e945d1c6817d8697ffcb68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84f0cd25a9e945d1c6817d8697ffcb68 columnFamilyName f1 2023-10-29 23:54:48,706 INFO [StoreOpener-84f0cd25a9e945d1c6817d8697ffcb68-1] regionserver.HStore(310): Store=84f0cd25a9e945d1c6817d8697ffcb68/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:48,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:48,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:48,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:48,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:54:48,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 84f0cd25a9e945d1c6817d8697ffcb68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59691867, jitterRate=-0.11052186787128448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:54:48,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 84f0cd25a9e945d1c6817d8697ffcb68: 2023-10-29 23:54:48,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68., pid=73, masterSystemTime=1698623688696 2023-10-29 23:54:48,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:48,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:48,714 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=84f0cd25a9e945d1c6817d8697ffcb68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:48,714 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698623688714"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623688714"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623688714"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623688714"}]},"ts":"1698623688714"} 2023-10-29 23:54:48,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-10-29 23:54:48,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 84f0cd25a9e945d1c6817d8697ffcb68, server=jenkins-hbase4.apache.org,40533,1698623599827 in 171 msec 2023-10-29 23:54:48,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-29 23:54:48,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=84f0cd25a9e945d1c6817d8697ffcb68, ASSIGN in 326 msec 2023-10-29 23:54:48,719 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:54:48,719 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623688719"}]},"ts":"1698623688719"} 2023-10-29 23:54:48,720 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-10-29 23:54:48,721 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:54:48,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1570 sec 2023-10-29 23:54:48,818 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-29 23:54:48,818 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-10-29 23:54:49,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 23:54:49,671 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-10-29 23:54:49,671 DEBUG [Listener at localhost/45261] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-10-29 23:54:49,672 INFO [Listener at localhost/45261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-29 23:54:49,675 INFO [Listener at localhost/45261] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-10-29 23:54:49,676 INFO [Listener at localhost/45261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-29 23:54:49,676 INFO [Listener at localhost/45261] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-10-29 23:54:49,679 INFO [Listener at localhost/45261] regionserver.HRegion(2745): Flushing 84f0cd25a9e945d1c6817d8697ffcb68 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-29 23:54:50,091 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029fd39bef305ff4617b0c19906701e4483 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029fd39bef305ff4617b0c19906701e4483 2023-10-29 23:54:50,496 INFO [Listener at localhost/45261] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/.tmp/f1/e3a0a1a0f7e246e39913be745a3f617e 2023-10-29 23:54:50,501 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/.tmp/f1/e3a0a1a0f7e246e39913be745a3f617e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e 2023-10-29 23:54:50,504 INFO [Listener at localhost/45261] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e, entries=1, sequenceid=5, filesize=4.9 K 2023-10-29 23:54:50,506 INFO [Listener at localhost/45261] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 84f0cd25a9e945d1c6817d8697ffcb68 in 827ms, sequenceid=5, compaction requested=false 2023-10-29 23:54:50,506 DEBUG [Listener at localhost/45261] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-10-29 23:54:50,506 DEBUG [Listener at localhost/45261] regionserver.HRegion(2446): Flush status journal for 84f0cd25a9e945d1c6817d8697ffcb68: 2023-10-29 23:54:50,508 INFO [Listener at localhost/45261] regionserver.HRegion(2745): Flushing 84f0cd25a9e945d1c6817d8697ffcb68 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-29 23:54:50,833 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:54:50,919 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102922ba337656ce447a8dffc327a27a0db9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023102922ba337656ce447a8dffc327a27a0db9 2023-10-29 23:54:51,324 INFO [Listener at localhost/45261] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/.tmp/f1/614a53e2cd1041e8bbdcb421ab5717e5 2023-10-29 23:54:51,329 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/.tmp/f1/614a53e2cd1041e8bbdcb421ab5717e5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5 2023-10-29 23:54:51,332 INFO [Listener at localhost/45261] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5, entries=1, sequenceid=9, filesize=4.9 K 2023-10-29 23:54:51,333 INFO [Listener at localhost/45261] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 84f0cd25a9e945d1c6817d8697ffcb68 in 825ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:51,333 DEBUG [Listener at localhost/45261] regionserver.HRegion(2446): Flush status journal for 84f0cd25a9e945d1c6817d8697ffcb68: 2023-10-29 23:54:51,334 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-10-29 23:54:51,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 23:54:51,336 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 23:54:51,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:51,337 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624291337 2023-10-29 23:54:51,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 23:54:51,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-10-29 23:54:51,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-10-29 23:54:51,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x50b635b6 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:54:51,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2734bd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:54:51,342 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testGetAfterCompaction' and column='f1' 2023-10-29 23:54:51,386 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,386 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,436 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,436 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,487 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,487 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,538 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,538 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,588 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,588 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,639 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,639 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,689 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,690 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,740 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,740 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,791 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,791 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,841 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,841 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,892 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,892 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,942 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,943 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,993 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:51,993 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,044 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,044 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,094 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,094 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,145 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,145 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,165 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310291a9ce56d8a39449295fd4b320895bc59 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310291a9ce56d8a39449295fd4b320895bc59 2023-10-29 23:54:52,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testGetAfterCompaction' column='f1' 2023-10-29 23:54:52,178 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:54:52,179 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:54:52,185 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:54:52,186 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:54:52,193 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/640a36f7bd1f4e4e81cc4bb25628ce39 first=Optional[r1] last=Optional[r2] 2023-10-29 23:54:52,194 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{f1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/640a36f7bd1f4e4e81cc4bb25628ce39}] 2023-10-29 23:54:52,196 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,196 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/640a36f7bd1f4e4e81cc4bb25628ce39 for inclusion in 84f0cd25a9e945d1c6817d8697ffcb68/f1 2023-10-29 23:54:52,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-29 23:54:52,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:54:52,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 84f0cd25a9e945d1c6817d8697ffcb68: 2023-10-29 23:54:52,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/640a36f7bd1f4e4e81cc4bb25628ce39 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testGetAfterCompaction__3vg5c3nigodao16bai77kc2latvu10uhsc0rd7u2j98d1i2llkt3m9fdfkntcibg/f1/640a36f7bd1f4e4e81cc4bb25628ce39 2023-10-29 23:54:52,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testGetAfterCompaction__3vg5c3nigodao16bai77kc2latvu10uhsc0rd7u2j98d1i2llkt3m9fdfkntcibg/f1/640a36f7bd1f4e4e81cc4bb25628ce39 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_ 2023-10-29 23:54:52,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testGetAfterCompaction__3vg5c3nigodao16bai77kc2latvu10uhsc0rd7u2j98d1i2llkt3m9fdfkntcibg/f1/640a36f7bd1f4e4e81cc4bb25628ce39 into 84f0cd25a9e945d1c6817d8697ffcb68/f1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_ - updating store file list. 2023-10-29 23:54:52,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_ into 84f0cd25a9e945d1c6817d8697ffcb68/f1 2023-10-29 23:54:52,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testGetAfterCompaction__3vg5c3nigodao16bai77kc2latvu10uhsc0rd7u2j98d1i2llkt3m9fdfkntcibg/f1/640a36f7bd1f4e4e81cc4bb25628ce39 into 84f0cd25a9e945d1c6817d8697ffcb68/f1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_) 2023-10-29 23:54:52,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testGetAfterCompaction__3vg5c3nigodao16bai77kc2latvu10uhsc0rd7u2j98d1i2llkt3m9fdfkntcibg/f1/640a36f7bd1f4e4e81cc4bb25628ce39 2023-10-29 23:54:52,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 84f0cd25a9e945d1c6817d8697ffcb68/f1 is initiating minor compaction 2023-10-29 23:54:52,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@71ac15fa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:52,207 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 84f0cd25a9e945d1c6817d8697ffcb68/f1 in testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:52,207 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/.tmp, totalSize=10.0 K 2023-10-29 23:54:52,207 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 614a53e2cd1041e8bbdcb421ab5717e5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:54:52,207 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 6cf52f7399a4473fb068b92a14b4f793_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:54:52,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testGetAfterCompaction' column='f1' 2023-10-29 23:54:52,209 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:52,211 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023102922ba337656ce447a8dffc327a27a0db9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023102922ba337656ce447a8dffc327a27a0db9 2023-10-29 23:54:52,212 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029fd39bef305ff4617b0c19906701e4483 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029fd39bef305ff4617b0c19906701e4483 2023-10-29 23:54:52,212 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-10-29 23:54:52,212 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 23:54:52,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testGetAfterCompaction' and column='f1' 2023-10-29 23:54:52,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-10-29 23:54:52,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:54:52,214 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 23:54:52,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 879 msec 2023-10-29 23:54:52,215 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 84f0cd25a9e945d1c6817d8697ffcb68#f1#compaction#76 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:54:52,247 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,247 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,247 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,250 DEBUG [Listener at localhost/45261] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 23:54:52,253 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 23:54:52,253 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40533] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:52,254 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-10-29 23:54:52,254 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 23:54:52,254 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40533] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 23:54:52,254 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40533] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. because compaction request was cancelled 2023-10-29 23:54:52,306 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,306 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,306 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,356 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,356 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,356 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,407 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,407 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,407 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,458 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,458 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,458 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,508 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,508 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,508 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,559 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,559 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,559 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,610 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,610 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,610 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,660 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,660 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,661 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,711 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,711 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,711 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,762 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,762 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,762 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,812 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,812 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,812 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,863 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,863 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,863 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,914 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,914 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,914 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,964 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:52,964 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:52,964 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,015 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,015 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:53,015 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,028 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/.tmp/f1/6f608f9bc627486ab8ca28cdb9ed5e90 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6f608f9bc627486ab8ca28cdb9ed5e90 2023-10-29 23:54:53,032 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 84f0cd25a9e945d1c6817d8697ffcb68/f1 of 84f0cd25a9e945d1c6817d8697ffcb68 into 6f608f9bc627486ab8ca28cdb9ed5e90(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:54:53,032 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 84f0cd25a9e945d1c6817d8697ffcb68: 2023-10-29 23:54:53,033 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698623692207; duration=0sec 2023-10-29 23:54:53,033 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:54:53,066 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623691324; access_time=1698623690510; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,066 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698623692161; access_time=1698623691353; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 23:54:53,066 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6f608f9bc627486ab8ca28cdb9ed5e90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698623693024; access_time=1698623692212; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,066 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_] to archive 2023-10-29 23:54:53,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:54:53,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/614a53e2cd1041e8bbdcb421ab5717e5 2023-10-29 23:54:53,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6cf52f7399a4473fb068b92a14b4f793_SeqId_12_ 2023-10-29 23:54:53,117 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6f608f9bc627486ab8ca28cdb9ed5e90; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698623693024; access_time=1698623692212; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,117 INFO [Listener at localhost/45261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698623690496; access_time=1698623689682; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 23:54:53,232 INFO [Listener at localhost/45261] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-10-29 23:54:53,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-10-29 23:54:53,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:53,244 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623693244"}]},"ts":"1698623693244"} 2023-10-29 23:54:53,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 23:54:53,245 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-10-29 23:54:53,248 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-10-29 23:54:53,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=84f0cd25a9e945d1c6817d8697ffcb68, UNASSIGN}] 2023-10-29 23:54:53,251 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=84f0cd25a9e945d1c6817d8697ffcb68, UNASSIGN 2023-10-29 23:54:53,251 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=84f0cd25a9e945d1c6817d8697ffcb68, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:53,251 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698623693251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623693251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623693251"}]},"ts":"1698623693251"} 2023-10-29 23:54:53,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 84f0cd25a9e945d1c6817d8697ffcb68, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:53,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 23:54:53,404 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:53,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:53,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 84f0cd25a9e945d1c6817d8697ffcb68, disabling compactions & flushes 2023-10-29 23:54:53,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:53,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:53,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. after waiting 0 ms 2023-10-29 23:54:53,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:53,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-29 23:54:53,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-29 23:54:53,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68. 2023-10-29 23:54:53,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 84f0cd25a9e945d1c6817d8697ffcb68: 2023-10-29 23:54:53,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:53,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=84f0cd25a9e945d1c6817d8697ffcb68, regionState=CLOSED 2023-10-29 23:54:53,411 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698623693410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623693410"}]},"ts":"1698623693410"} 2023-10-29 23:54:53,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-29 23:54:53,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 84f0cd25a9e945d1c6817d8697ffcb68, server=jenkins-hbase4.apache.org,40533,1698623599827 in 159 msec 2023-10-29 23:54:53,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-10-29 23:54:53,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=84f0cd25a9e945d1c6817d8697ffcb68, UNASSIGN in 163 msec 2023-10-29 23:54:53,414 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623693414"}]},"ts":"1698623693414"} 2023-10-29 23:54:53,415 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-10-29 23:54:53,419 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-10-29 23:54:53,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-10-29 23:54:53,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 23:54:53,547 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-10-29 23:54:53,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-10-29 23:54:53,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:53,559 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:53,560 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:53,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-29 23:54:53,563 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:53,565 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1, FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/recovered.edits] 2023-10-29 23:54:53,568 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6f608f9bc627486ab8ca28cdb9ed5e90 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/6f608f9bc627486ab8ca28cdb9ed5e90 2023-10-29 23:54:53,569 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/f1/e3a0a1a0f7e246e39913be745a3f617e 2023-10-29 23:54:53,571 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/recovered.edits/15.seqid to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68/recovered.edits/15.seqid 2023-10-29 23:54:53,572 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testGetAfterCompaction/84f0cd25a9e945d1c6817d8697ffcb68 2023-10-29 23:54:53,572 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-29 23:54:53,572 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-29 23:54:53,572 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-10-29 23:54:53,575 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310291a9ce56d8a39449295fd4b320895bc59 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310291a9ce56d8a39449295fd4b320895bc59 2023-10-29 23:54:53,576 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-29 23:54:53,577 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:53,596 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-10-29 23:54:53,598 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-10-29 23:54:53,599 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:53,599 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-10-29 23:54:53,599 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698623693599"}]},"ts":"9223372036854775807"} 2023-10-29 23:54:53,601 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-29 23:54:53,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 84f0cd25a9e945d1c6817d8697ffcb68, NAME => 'testGetAfterCompaction,,1698623687563.84f0cd25a9e945d1c6817d8697ffcb68.', STARTKEY => '', ENDKEY => ''}] 2023-10-29 23:54:53,601 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-10-29 23:54:53,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698623693601"}]},"ts":"9223372036854775807"} 2023-10-29 23:54:53,602 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-10-29 23:54:53,605 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 23:54:53,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 52 msec 2023-10-29 23:54:53,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-29 23:54:53,662 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-10-29 23:54:53,674 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=247 (was 246) - Thread LEAK? -, OpenFileDescriptor=622 (was 626), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 135), ProcessCount=167 (was 169), AvailableMemoryMB=14204 (was 14211) 2023-10-29 23:54:53,684 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=247, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=167, AvailableMemoryMB=14204 2023-10-29 23:54:53,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 23:54:53,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-10-29 23:54:53,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:54:53,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-10-29 23:54:53,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:54:53,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 23:54:53,690 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:53,690 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901 2023-10-29 23:54:53,690 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:53,691 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e empty. 2023-10-29 23:54:53,691 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7 empty. 2023-10-29 23:54:53,691 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901 empty. 2023-10-29 23:54:53,691 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:53,691 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901 2023-10-29 23:54:53,691 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:53,691 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-10-29 23:54:53,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 23:54:53,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 23:54:54,098 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-29 23:54:54,099 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => e64684f25940ad580cd493bca8b0ccb7, NAME => 'testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:54:54,100 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc879cf7ad8f38cb32285196def3085e, NAME => 'testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:54:54,100 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => f4685077c709633cc85813f6672ca901, NAME => 'testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:54:54,108 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:54,108 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing f4685077c709633cc85813f6672ca901, disabling compactions & flushes 2023-10-29 23:54:54,108 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:54,108 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:54,108 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. after waiting 0 ms 2023-10-29 23:54:54,108 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:54,108 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:54,108 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:54:54,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing dc879cf7ad8f38cb32285196def3085e, disabling compactions & flushes 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing e64684f25940ad580cd493bca8b0ccb7, disabling compactions & flushes 2023-10-29 23:54:54,506 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:54,506 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. after waiting 0 ms 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:54,506 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. after waiting 0 ms 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:54,506 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:54,506 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:54:54,508 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:54:54,509 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623694509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623694509"}]},"ts":"1698623694509"} 2023-10-29 23:54:54,509 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623694509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623694509"}]},"ts":"1698623694509"} 2023-10-29 23:54:54,509 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623694509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623694509"}]},"ts":"1698623694509"} 2023-10-29 23:54:54,511 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 23:54:54,511 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:54:54,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623694511"}]},"ts":"1698623694511"} 2023-10-29 23:54:54,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-29 23:54:54,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN}] 2023-10-29 23:54:54,518 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN 2023-10-29 23:54:54,518 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN 2023-10-29 23:54:54,518 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN 2023-10-29 23:54:54,518 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:54:54,518 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:54:54,518 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:54:54,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=e64684f25940ad580cd493bca8b0ccb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:54,670 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f4685077c709633cc85813f6672ca901, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:54,670 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=dc879cf7ad8f38cb32285196def3085e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:54,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623694670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623694670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623694670"}]},"ts":"1698623694670"} 2023-10-29 23:54:54,670 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623694670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623694670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623694670"}]},"ts":"1698623694670"} 2023-10-29 23:54:54,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623694670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623694670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623694670"}]},"ts":"1698623694670"} 2023-10-29 23:54:54,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure e64684f25940ad580cd493bca8b0ccb7, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:54,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure f4685077c709633cc85813f6672ca901, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:54,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure dc879cf7ad8f38cb32285196def3085e, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:54:54,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 23:54:54,825 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:54,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:54,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4685077c709633cc85813f6672ca901, NAME => 'testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 23:54:54,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:54,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,829 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,830 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:54:54,830 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:54:54,831 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4685077c709633cc85813f6672ca901 columnFamilyName family1 2023-10-29 23:54:54,832 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(310): Store=f4685077c709633cc85813f6672ca901/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:54,832 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,833 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2 2023-10-29 23:54:54,833 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2 2023-10-29 23:54:54,834 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4685077c709633cc85813f6672ca901 columnFamilyName family2 2023-10-29 23:54:54,835 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(310): Store=f4685077c709633cc85813f6672ca901/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:54,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:54:54,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4685077c709633cc85813f6672ca901 2023-10-29 23:54:54,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:54:54,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4685077c709633cc85813f6672ca901; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58734147, jitterRate=-0.12479300796985626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:54:54,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:54:54,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901., pid=84, masterSystemTime=1698623694825 2023-10-29 23:54:54,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:54,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:54,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:54,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc879cf7ad8f38cb32285196def3085e, NAME => 'testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 23:54:54,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f4685077c709633cc85813f6672ca901, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:54,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:54,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623694843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623694843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623694843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623694843"}]},"ts":"1698623694843"} 2023-10-29 23:54:54,844 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,845 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:54:54,845 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:54:54,845 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc879cf7ad8f38cb32285196def3085e columnFamilyName family1 2023-10-29 23:54:54,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-10-29 23:54:54,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure f4685077c709633cc85813f6672ca901, server=jenkins-hbase4.apache.org,40533,1698623599827 in 172 msec 2023-10-29 23:54:54,846 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(310): Store=dc879cf7ad8f38cb32285196def3085e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:54,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN in 331 msec 2023-10-29 23:54:54,847 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,848 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2 2023-10-29 23:54:54,848 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2 2023-10-29 23:54:54,848 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc879cf7ad8f38cb32285196def3085e columnFamilyName family2 2023-10-29 23:54:54,849 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(310): Store=dc879cf7ad8f38cb32285196def3085e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:54,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:54:54,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:54:54,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:54:54,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc879cf7ad8f38cb32285196def3085e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60433530, jitterRate=-0.09947022795677185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:54:54,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:54:54,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e., pid=85, masterSystemTime=1698623694825 2023-10-29 23:54:54,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:54,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:54,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:54,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e64684f25940ad580cd493bca8b0ccb7, NAME => 'testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 23:54:54,856 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=dc879cf7ad8f38cb32285196def3085e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:54,856 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623694856"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623694856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623694856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623694856"}]},"ts":"1698623694856"} 2023-10-29 23:54:54,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:54:54,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,858 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,859 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:54:54,859 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:54:54,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-10-29 23:54:54,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure dc879cf7ad8f38cb32285196def3085e, server=jenkins-hbase4.apache.org,40533,1698623599827 in 184 msec 2023-10-29 23:54:54,859 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64684f25940ad580cd493bca8b0ccb7 columnFamilyName family1 2023-10-29 23:54:54,860 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(310): Store=e64684f25940ad580cd493bca8b0ccb7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:54,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN in 344 msec 2023-10-29 23:54:54,860 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,862 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2 2023-10-29 23:54:54,862 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2 2023-10-29 23:54:54,862 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64684f25940ad580cd493bca8b0ccb7 columnFamilyName family2 2023-10-29 23:54:54,863 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(310): Store=e64684f25940ad580cd493bca8b0ccb7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:54:54,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:54:54,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:54:54,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:54:54,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e64684f25940ad580cd493bca8b0ccb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71234578, jitterRate=0.06147792935371399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:54:54,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:54:54,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7., pid=83, masterSystemTime=1698623694825 2023-10-29 23:54:54,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:54,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:54,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=e64684f25940ad580cd493bca8b0ccb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:54,870 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623694870"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623694870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623694870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623694870"}]},"ts":"1698623694870"} 2023-10-29 23:54:54,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=82 2023-10-29 23:54:54,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure e64684f25940ad580cd493bca8b0ccb7, server=jenkins-hbase4.apache.org,40533,1698623599827 in 199 msec 2023-10-29 23:54:54,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=79 2023-10-29 23:54:54,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN in 356 msec 2023-10-29 23:54:54,874 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:54:54,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623694874"}]},"ts":"1698623694874"} 2023-10-29 23:54:54,875 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-29 23:54:54,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:54:54,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1910 sec 2023-10-29 23:54:55,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 23:54:55,793 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-10-29 23:54:55,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:55,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:55,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:55,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:55,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 23:54:55,805 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 23:54:55,805 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:55,805 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 23:54:55,805 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 23:54:55,806 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:55,806 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:55,808 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:55,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:55,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:55,808 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:55,808 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:55,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:55,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:55,809 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 23:54:55,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 23:54:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 23:54:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 23:54:55,809 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:55,809 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. started... 2023-10-29 23:54:55,809 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:54:55,810 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:55,810 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. started... 2023-10-29 23:54:55,810 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e64684f25940ad580cd493bca8b0ccb7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:54:55,809 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. started... 2023-10-29 23:54:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:55,810 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f4685077c709633cc85813f6672ca901 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:54:55,811 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing dc879cf7ad8f38cb32285196def3085e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:54:56,227 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd 2023-10-29 23:54:56,227 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 2023-10-29 23:54:56,227 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 2023-10-29 23:54:56,233 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/a11b27a0bb6a47b8a108a21ced420c63 2023-10-29 23:54:56,634 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/6a094639617b4da692775e72b4ac1d56 2023-10-29 23:54:56,634 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/75b0e82e07c345d0aebf3ac3bee9f997 2023-10-29 23:54:56,647 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029249df982251047c29a7c11bb3b3408ef to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029249df982251047c29a7c11bb3b3408ef 2023-10-29 23:54:56,649 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310297dd11a0245aa4a0ea47ad46d782af8ad to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297dd11a0245aa4a0ea47ad46d782af8ad 2023-10-29 23:54:57,049 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029e0cc12f4b6c64ab69d82c50bbd51f559 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029e0cc12f4b6c64ab69d82c50bbd51f559 2023-10-29 23:54:57,052 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/714febe945864f84ad7ec8c51ebc770a 2023-10-29 23:54:57,054 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/293fc688f0544badb4d195374f3149c3 2023-10-29 23:54:57,056 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/a11b27a0bb6a47b8a108a21ced420c63 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63 2023-10-29 23:54:57,058 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/6a094639617b4da692775e72b4ac1d56 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56 2023-10-29 23:54:57,060 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 23:54:57,061 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/714febe945864f84ad7ec8c51ebc770a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a 2023-10-29 23:54:57,061 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 23:54:57,062 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/293fc688f0544badb4d195374f3149c3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3 2023-10-29 23:54:57,064 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:54:57,065 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for dc879cf7ad8f38cb32285196def3085e in 1254ms, sequenceid=5, compaction requested=false 2023-10-29 23:54:57,065 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 23:54:57,065 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:54:57,065 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:54:57,065 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:57,065 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:54:57,066 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e64684f25940ad580cd493bca8b0ccb7 in 1256ms, sequenceid=5, compaction requested=false 2023-10-29 23:54:57,066 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:54:57,066 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:57,066 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:54:57,454 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/9de024002acd4492bd34872e8c74ef2b 2023-10-29 23:54:57,458 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/75b0e82e07c345d0aebf3ac3bee9f997 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997 2023-10-29 23:54:57,462 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 23:54:57,462 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/9de024002acd4492bd34872e8c74ef2b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b 2023-10-29 23:54:57,466 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:54:57,467 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f4685077c709633cc85813f6672ca901 in 1657ms, sequenceid=5, compaction requested=false 2023-10-29 23:54:57,467 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:54:57,467 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:54:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:54:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 23:54:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 23:54:57,468 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,468 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:57,469 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,469 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:57,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:57,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 23:54:57,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f32ea41[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:57,470 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 23:54:57,470 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,471 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,471 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 23:54:57,471 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 23:54:57,471 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:57,471 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,471 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:57,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,472 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 23:54:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:57,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:57,472 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:57,472 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 23:54:57,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:57,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:57,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:57,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:57,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:57,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:57,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 23:54:57,474 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 23:54:57,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:57,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:57,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 23:54:57,474 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:57,477 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,477 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:57,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,477 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:57,477 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:57,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:57,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:57,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:57,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:57,478 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:57,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:57,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,480 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,480 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:57,480 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:57,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:57,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 23:54:57,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:57,480 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:57,480 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:57,480 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:57,480 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:57,481 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,481 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:57,481 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:57,481 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:57,481 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:57,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:57,581 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:57,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:57,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:57,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:57,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:57,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:57,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:57,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 23:54:57,588 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 23:54:57,588 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:57,588 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 23:54:57,588 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 23:54:57,588 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,588 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:57,589 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:57,589 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:57,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:57,590 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:57,590 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:57,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:57,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:57,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 23:54:57,590 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 23:54:57,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 23:54:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 23:54:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 23:54:57,591 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:57,591 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. started... 2023-10-29 23:54:57,591 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:57,591 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. started... 2023-10-29 23:54:57,591 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e64684f25940ad580cd493bca8b0ccb7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:54:57,591 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing dc879cf7ad8f38cb32285196def3085e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:54:57,597 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:54:57,597 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:57,597 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:57,597 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. started... 2023-10-29 23:54:57,597 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f4685077c709633cc85813f6672ca901 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:54:58,014 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 2023-10-29 23:54:58,014 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 2023-10-29 23:54:58,018 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 2023-10-29 23:54:58,424 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/218cf0b723d14ff49367d56be3e7be63 2023-10-29 23:54:58,427 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/2655c4ad3e4a436f92c6daa8884d7527 2023-10-29 23:54:58,428 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/829873d2eebf4b5f984fac02d207f42b 2023-10-29 23:54:58,840 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310291e5b41c34eea40f7bca751515066122f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291e5b41c34eea40f7bca751515066122f 2023-10-29 23:54:58,842 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029d7b332a8a0224ccd80992fe4d8ffc880 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d7b332a8a0224ccd80992fe4d8ffc880 2023-10-29 23:54:58,842 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029df425f60cc354809bf32b7feb0108c48 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029df425f60cc354809bf32b7feb0108c48 2023-10-29 23:54:58,854 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/37a7c8481f714189932cc8f93bd12632 2023-10-29 23:54:58,858 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/2655c4ad3e4a436f92c6daa8884d7527 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527 2023-10-29 23:54:58,861 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 23:54:58,862 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/37a7c8481f714189932cc8f93bd12632 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632 2023-10-29 23:54:58,865 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:54:58,865 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for dc879cf7ad8f38cb32285196def3085e in 1274ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:58,865 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:54:58,865 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:58,865 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:54:58,910 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:54:58,947 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-29 23:54:59,246 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/9c80630656ff4b44985fda82ea53a712 2023-10-29 23:54:59,251 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/218cf0b723d14ff49367d56be3e7be63 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63 2023-10-29 23:54:59,252 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/9d51fae5a73d4c919eebe6a25c8d94a5 2023-10-29 23:54:59,255 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 23:54:59,255 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/9c80630656ff4b44985fda82ea53a712 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712 2023-10-29 23:54:59,256 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/829873d2eebf4b5f984fac02d207f42b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b 2023-10-29 23:54:59,259 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:54:59,260 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e64684f25940ad580cd493bca8b0ccb7 in 1669ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:59,260 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:54:59,260 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:59,260 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:54:59,260 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 23:54:59,261 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/9d51fae5a73d4c919eebe6a25c8d94a5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5 2023-10-29 23:54:59,264 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:54:59,265 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f4685077c709633cc85813f6672ca901 in 1668ms, sequenceid=9, compaction requested=false 2023-10-29 23:54:59,265 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:54:59,265 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:59,265 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:54:59,265 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:54:59,265 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,265 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 23:54:59,265 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 23:54:59,267 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,267 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:59,267 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,267 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:54:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:59,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:59,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:59,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 23:54:59,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b8b28fa[Count = 0] remaining members to acquire global barrier 2023-10-29 23:54:59,268 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 23:54:59,268 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,269 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,269 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 23:54:59,269 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 23:54:59,269 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:54:59,270 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,270 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:54:59,271 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 23:54:59,271 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,271 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:59,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:59,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:59,271 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 23:54:59,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:59,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:59,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:59,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:59,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:59,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:54:59,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 23:54:59,273 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 23:54:59,273 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:54:59,273 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:54:59,273 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 23:54:59,273 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:54:59,277 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,277 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:54:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:54:59,277 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:54:59,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:59,278 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:54:59,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:59,279 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:54:59,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:54:59,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,281 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,281 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:59,281 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:59,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:59,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:59,281 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:54:59,281 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:54:59,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 23:54:59,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:54:59,281 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:59,281 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:54:59,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:54:59,281 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,282 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:54:59,282 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,282 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 23:54:59,282 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:54:59,382 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:54:59,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:54:59,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:59,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:59,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:54:59,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:54:59,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 23:54:59,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 23:54:59,388 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 23:54:59,388 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:59,388 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 23:54:59,388 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 23:54:59,388 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,388 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:59,389 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:54:59,389 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:54:59,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:54:59,390 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:54:59,390 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:54:59,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:59,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:54:59,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:54:59,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:54:59,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 23:54:59,391 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 23:54:59,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 23:54:59,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 23:54:59,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:54:59,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 23:54:59,391 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:54:59,391 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. started... 2023-10-29 23:54:59,391 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:54:59,391 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. started... 2023-10-29 23:54:59,391 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e64684f25940ad580cd493bca8b0ccb7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:54:59,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:54:59,391 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing dc879cf7ad8f38cb32285196def3085e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:54:59,391 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:54:59,391 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:54:59,391 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. started... 2023-10-29 23:54:59,391 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f4685077c709633cc85813f6672ca901 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:54:59,410 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f 2023-10-29 23:54:59,410 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac 2023-10-29 23:54:59,416 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/dfa4839734fc47d3a1f5a326a9f67ece 2023-10-29 23:54:59,809 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 2023-10-29 23:54:59,817 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/a7c81bb5b3ab433f8a5a0d001b05603c 2023-10-29 23:54:59,830 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310297ebce1f5ccfc45b39951ae61b51f13b6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297ebce1f5ccfc45b39951ae61b51f13b6 2023-10-29 23:55:00,214 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/8632d275427e465dad17149751af6be7 2023-10-29 23:55:00,229 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310294374e64a29d5472cad15c920780919a0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310294374e64a29d5472cad15c920780919a0 2023-10-29 23:55:00,234 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/26851ed553204189bc1e252f1a027182 2023-10-29 23:55:00,237 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/dfa4839734fc47d3a1f5a326a9f67ece as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece 2023-10-29 23:55:00,240 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 23:55:00,241 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/26851ed553204189bc1e252f1a027182 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182 2023-10-29 23:55:00,244 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:00,245 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e64684f25940ad580cd493bca8b0ccb7 in 854ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:00,245 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:00,245 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:00,245 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:00,627 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310295cf6e7f525934fceb2a7ed45789e03d3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295cf6e7f525934fceb2a7ed45789e03d3 2023-10-29 23:55:00,633 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e 2023-10-29 23:55:00,637 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/a7c81bb5b3ab433f8a5a0d001b05603c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c 2023-10-29 23:55:00,640 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 23:55:00,640 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e 2023-10-29 23:55:00,644 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:00,644 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for dc879cf7ad8f38cb32285196def3085e in 1253ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:00,645 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:00,645 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:00,645 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:01,032 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/1472ed6ac3ea4e819d399c51690dcc41 2023-10-29 23:55:01,036 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/8632d275427e465dad17149751af6be7 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7 2023-10-29 23:55:01,040 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 23:55:01,040 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/1472ed6ac3ea4e819d399c51690dcc41 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41 2023-10-29 23:55:01,045 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:01,046 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f4685077c709633cc85813f6672ca901 in 1655ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:01,046 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:01,046 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:01,046 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:01,046 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:01,046 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,047 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 23:55:01,047 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 23:55:01,048 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,048 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:01,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:01,048 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,048 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:01,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:01,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:01,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:01,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:01,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 23:55:01,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eb812fe[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:01,050 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 23:55:01,050 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,051 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,052 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 23:55:01,052 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 23:55:01,052 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:01,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:01,053 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 23:55:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:01,053 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 23:55:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:01,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 23:55:01,055 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 23:55:01,055 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:01,055 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:01,055 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 23:55:01,055 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:01,060 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,060 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:01,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,060 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:01,060 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:01,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:01,061 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:01,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:01,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:01,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:01,063 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:01,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:01,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 23:55:01,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:01,064 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:01,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:01,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:01,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:01,064 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,164 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:01,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:01,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:01,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:01,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:01,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:01,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:01,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 23:55:01,171 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 23:55:01,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:01,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 23:55:01,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 23:55:01,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,171 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:01,172 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:01,172 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:01,172 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:01,173 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:01,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:01,173 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 23:55:01,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 23:55:01,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 23:55:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 23:55:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 23:55:01,174 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:01,174 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. started... 2023-10-29 23:55:01,174 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:01,174 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. started... 2023-10-29 23:55:01,174 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e64684f25940ad580cd493bca8b0ccb7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:01,174 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing dc879cf7ad8f38cb32285196def3085e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:01,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:01,176 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. started... 2023-10-29 23:55:01,176 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f4685077c709633cc85813f6672ca901 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:01,190 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b 2023-10-29 23:55:01,587 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 2023-10-29 23:55:01,590 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c 2023-10-29 23:55:01,597 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/2ef6f913db2d4d93997af18ab767ca6f 2023-10-29 23:55:01,608 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310295bfbded4a2ea4ec1b78b0a9498c66fd7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310295bfbded4a2ea4ec1b78b0a9498c66fd7 2023-10-29 23:55:01,992 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/3cdf25c230f542dc824156892aad218b 2023-10-29 23:55:01,995 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2 2023-10-29 23:55:02,012 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/10be3d969a1e4375926a9ace1c69582d 2023-10-29 23:55:02,015 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/2ef6f913db2d4d93997af18ab767ca6f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f 2023-10-29 23:55:02,018 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 23:55:02,019 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/10be3d969a1e4375926a9ace1c69582d as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d 2023-10-29 23:55:02,022 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:02,023 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e64684f25940ad580cd493bca8b0ccb7 in 849ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:02,023 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:02,023 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:02,023 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:02,411 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310293462a81649ce4106819d25d72f166a60 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293462a81649ce4106819d25d72f166a60 2023-10-29 23:55:02,413 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029ee1187e24b7f4926b3c8b6b25ca6a006 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ee1187e24b7f4926b3c8b6b25ca6a006 2023-10-29 23:55:02,816 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/c983ae66781e457181f10a4c988b1033 2023-10-29 23:55:02,817 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/0bdb82b92ee64389904f8a330571af37 2023-10-29 23:55:02,820 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/3cdf25c230f542dc824156892aad218b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b 2023-10-29 23:55:02,822 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2 2023-10-29 23:55:02,824 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 23:55:02,825 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/c983ae66781e457181f10a4c988b1033 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033 2023-10-29 23:55:02,825 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 23:55:02,826 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/0bdb82b92ee64389904f8a330571af37 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37 2023-10-29 23:55:02,828 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:02,829 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for dc879cf7ad8f38cb32285196def3085e in 1655ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:02,829 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:02,829 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:02,830 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:02,830 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f4685077c709633cc85813f6672ca901 in 1654ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:02,830 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:02,830 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:02,830 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:02,830 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:02,830 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,830 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 23:55:02,831 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 23:55:02,832 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,832 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:02,832 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,832 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:02,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:02,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 23:55:02,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@620a86f4[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:02,834 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 23:55:02,834 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,835 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,835 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 23:55:02,835 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 23:55:02,836 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:02,836 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,836 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:02,837 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 23:55:02,837 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,837 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,837 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 23:55:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:02,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:02,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:02,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:02,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:02,839 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 23:55:02,839 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:02,839 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:02,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 23:55:02,839 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 23:55:02,839 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:02,840 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:02,840 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:02,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:02,840 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:02,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:02,841 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:02,842 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:02,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 23:55:02,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 23:55:02,844 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:02,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:02,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:02,844 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:02,845 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:02,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:02,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:02,945 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:02,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:03,103 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-10-29 23:55:03,103 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:55:03,104 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50b635b6 to 127.0.0.1:50259 2023-10-29 23:55:03,104 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:03,104 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:55:03,104 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x465d09e7 to 127.0.0.1:50259 2023-10-29 23:55:03,104 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:03,104 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27a51bbc to 127.0.0.1:50259 2023-10-29 23:55:03,104 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:03,104 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:55:03,104 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a395a74 to 127.0.0.1:50259 2023-10-29 23:55:03,104 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:03,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 23:55:03,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698623703108 (current time:1698623703108). 2023-10-29 23:55:03,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-29 23:55:03,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] zookeeper.ReadOnlyZKClient(139): Connect 0x3c95e37b to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:55:03,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bee0174, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:55:03,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:55:03,123 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:55:03,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c95e37b to 127.0.0.1:50259 2023-10-29 23:55:03,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:03,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-29 23:55:03,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 23:55:03,135 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot, current working dir path: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/snaptb-1698623702946 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-29 23:55:03,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 23:55:03,144 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 23:55:03,144 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698624303144 2023-10-29 23:55:03,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 23:55:03,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698623702946 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-29 23:55:03,146 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 23:55:03,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 23:55:03,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-10-29 23:55:03,147 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 23:55:03,148 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698624303148 2023-10-29 23:55:03,150 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:03,150 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-29 23:55:03,250 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:03,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:03,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:03,254 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-29 23:55:03,454 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:03,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:03,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:03,455 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-29 23:55:03,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698623702946 2023-10-29 23:55:03,557 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698623702946' 2023-10-29 23:55:03,557 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-29 23:55:03,557 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698623702946' starting 'acquire' 2023-10-29 23:55:03,557 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698623702946', kicking off acquire phase on members. 2023-10-29 23:55:03,558 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,558 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698623702946 2023-10-29 23:55:03,560 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,560 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-29 23:55:03,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-29 23:55:03,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 23:55:03,560 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,560 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:03,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698623702946 2023-10-29 23:55:03,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-10-29 23:55:03,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698623702946 2023-10-29 23:55:03,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698623702946 from table testCompactionWithHFileLink type FLUSH 2023-10-29 23:55:03,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698623702946 2023-10-29 23:55:03,563 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698623702946' with timeout 300000ms 2023-10-29 23:55:03,563 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-29 23:55:03,563 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698623702946' starting 'acquire' stage 2023-10-29 23:55:03,563 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698623702946' locally acquired 2023-10-29 23:55:03,563 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (snaptb-1698623702946) in zk 2023-10-29 23:55:03,564 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,565 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 23:55:03,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,565 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698623702946' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:03,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698623702946 2023-10-29 23:55:03,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:03,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'snaptb-1698623702946' on coordinator 2023-10-29 23:55:03,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aa20816[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:03,566 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698623702946' starting 'in-barrier' execution. 2023-10-29 23:55:03,566 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,567 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,567 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698623702946' received 'reached' from coordinator. 2023-10-29 23:55:03,567 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,567 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:03,568 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:03,568 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:03,568 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:03,568 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-10-29 23:55:03,568 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-29 23:55:03,568 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. started... 2023-10-29 23:55:03,568 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. started... 2023-10-29 23:55:03,568 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. started... 2023-10-29 23:55:03,569 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:03,569 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:03,569 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:03,569 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.' region-info for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,569 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.' region-info for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,569 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.' region-info for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,574 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 23:55:03,574 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 23:55:03,574 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 23:55:03,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f] hfiles 2023-10-29 23:55:03,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2] hfiles 2023-10-29 23:55:03,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b] hfiles 2023-10-29 23:55:03,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,578 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d] hfiles 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033] hfiles 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37] hfiles 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033 for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,588 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. completed. 2023-10-29 23:55:03,588 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:03,588 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-10-29 23:55:03,755 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:03,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:03,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:03,756 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-29 23:55:03,988 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. completed. 2023-10-29 23:55:03,988 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:03,988 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-10-29 23:55:03,988 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. completed. 2023-10-29 23:55:03,989 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:03,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-10-29 23:55:03,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-10-29 23:55:03,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698623702946' locally completed 2023-10-29 23:55:03,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698623702946' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698623702946' has notified controller of completion 2023-10-29 23:55:03,991 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:03,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698623702946' completed. 2023-10-29 23:55:03,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:03,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 23:55:03,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:03,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:03,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698623702946 2023-10-29 23:55:03,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:03,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698623702946 2023-10-29 23:55:03,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698623702946' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:03,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'snaptb-1698623702946', counting down latch. Waiting for 0 more 2023-10-29 23:55:03,994 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698623702946' execution completed 2023-10-29 23:55:03,994 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:03,994 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:03,994 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698623702946 2023-10-29 23:55:03,994 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698623702946including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-29 23:55:03,995 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,995 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,995 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-29 23:55:03,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:03,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 23:55:03,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:03,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-29 23:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 23:55:03,996 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698623702946 2023-10-29 23:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698623702946 2023-10-29 23:55:03,997 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:03,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698623702946 2023-10-29 23:55:03,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698623702946 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698623702946 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698623702946/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,999 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:03,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698623702946 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698623702946 2023-10-29 23:55:03,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698623702946 2023-10-29 23:55:03,999 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-29 23:55:03,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-29 23:55:03,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698623702946 2023-10-29 23:55:03,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 23:55:03,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-29 23:55:04,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-29 23:55:04,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 23:55:04,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303] mob files 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd 2023-10-29 23:55:04,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295cf6e7f525934fceb2a7ed45789e03d3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029df425f60cc354809bf32b7feb0108c48, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029e0cc12f4b6c64ab69d82c50bbd51f559, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ee1187e24b7f4926b3c8b6b25ca6a006, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291e5b41c34eea40f7bca751515066122f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310295bfbded4a2ea4ec1b78b0a9498c66fd7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297dd11a0245aa4a0ea47ad46d782af8ad, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297ebce1f5ccfc45b39951ae61b51f13b6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029249df982251047c29a7c11bb3b3408ef, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293462a81649ce4106819d25d72f166a60, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310294374e64a29d5472cad15c920780919a0, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d7b332a8a0224ccd80992fe4d8ffc880] mob files 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295cf6e7f525934fceb2a7ed45789e03d3 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029df425f60cc354809bf32b7feb0108c48 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029e0cc12f4b6c64ab69d82c50bbd51f559 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ee1187e24b7f4926b3c8b6b25ca6a006 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291e5b41c34eea40f7bca751515066122f 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310295bfbded4a2ea4ec1b78b0a9498c66fd7 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297dd11a0245aa4a0ea47ad46d782af8ad 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297ebce1f5ccfc45b39951ae61b51f13b6 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029249df982251047c29a7c11bb3b3408ef 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293462a81649ce4106819d25d72f166a60 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310294374e64a29d5472cad15c920780919a0 2023-10-29 23:55:04,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d7b332a8a0224ccd80992fe4d8ffc880 2023-10-29 23:55:04,256 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:04,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:04,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:04,257 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-29 23:55:04,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698623702946 2023-10-29 23:55:04,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/snaptb-1698623702946 2023-10-29 23:55:04,450 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:55:04,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/snaptb-1698623702946 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/snaptb-1698623702946 2023-10-29 23:55:04,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698623702946 of table testCompactionWithHFileLink completed 2023-10-29 23:55:04,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/snaptb-1698623702946 2023-10-29 23:55:04,859 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/snaptb-1698623702946 2023-10-29 23:55:04,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698623702946 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698623703145Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698623704407 (+1262 ms)Consolidate snapshot: snaptb-1698623702946 at 1698623704407Loading Region manifests for snaptb-1698623702946 at 1698623704407Writing data manifest for snaptb-1698623702946 at 1698623704419 (+12 ms)Verifying snapshot: snaptb-1698623702946 at 1698623704826 (+407 ms)Snapshot snaptb-1698623702946 of table testCompactionWithHFileLink completed at 1698623704858 (+32 ms) 2023-10-29 23:55:04,860 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 23:55:04,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7140 sec 2023-10-29 23:55:05,257 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:05,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:05,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-29 23:55:05,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:05,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:05,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 23:55:05,289 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 23:55:05,289 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:05,289 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 23:55:05,289 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 23:55:05,290 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:05,290 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:05,291 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:05,291 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:05,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:05,291 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:05,291 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:05,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:05,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:05,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:05,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:05,292 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 23:55:05,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 23:55:05,292 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 23:55:05,292 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:05,292 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 23:55:05,292 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:05,293 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:05,293 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. started... 2023-10-29 23:55:05,293 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:05,293 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. started... 2023-10-29 23:55:05,293 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:05,293 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:05,293 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing dc879cf7ad8f38cb32285196def3085e 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:05,293 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e64684f25940ad580cd493bca8b0ccb7 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:05,293 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. started... 2023-10-29 23:55:05,293 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f4685077c709633cc85813f6672ca901 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:05,710 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/454204240a9d451bae0208593bb07fb1 2023-10-29 23:55:05,711 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/9c6c70ccdbc34d02b5d48b5b92575e7f 2023-10-29 23:55:05,714 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 454204240a9d451bae0208593bb07fb1 2023-10-29 23:55:05,714 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c6c70ccdbc34d02b5d48b5b92575e7f 2023-10-29 23:55:06,110 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/8891a9a9eb8640a18a0a61733cd49e72 2023-10-29 23:55:06,114 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8891a9a9eb8640a18a0a61733cd49e72 2023-10-29 23:55:06,525 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/41e706d6635e4434a26c8fadacd20a93 2023-10-29 23:55:06,526 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/8c68656730c34b96b77ee1c6a3878c49 2023-10-29 23:55:06,529 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41e706d6635e4434a26c8fadacd20a93 2023-10-29 23:55:06,529 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c68656730c34b96b77ee1c6a3878c49 2023-10-29 23:55:06,529 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/9c6c70ccdbc34d02b5d48b5b92575e7f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/9c6c70ccdbc34d02b5d48b5b92575e7f 2023-10-29 23:55:06,530 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/454204240a9d451bae0208593bb07fb1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/454204240a9d451bae0208593bb07fb1 2023-10-29 23:55:06,533 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c6c70ccdbc34d02b5d48b5b92575e7f 2023-10-29 23:55:06,533 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/9c6c70ccdbc34d02b5d48b5b92575e7f, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 23:55:06,534 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 454204240a9d451bae0208593bb07fb1 2023-10-29 23:55:06,534 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/454204240a9d451bae0208593bb07fb1, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 23:55:06,534 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/41e706d6635e4434a26c8fadacd20a93 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/41e706d6635e4434a26c8fadacd20a93 2023-10-29 23:55:06,534 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/8c68656730c34b96b77ee1c6a3878c49 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/8c68656730c34b96b77ee1c6a3878c49 2023-10-29 23:55:06,538 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c68656730c34b96b77ee1c6a3878c49 2023-10-29 23:55:06,538 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/8c68656730c34b96b77ee1c6a3878c49, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 23:55:06,538 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41e706d6635e4434a26c8fadacd20a93 2023-10-29 23:55:06,538 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/41e706d6635e4434a26c8fadacd20a93, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 23:55:06,539 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for dc879cf7ad8f38cb32285196def3085e in 1246ms, sequenceid=24, compaction requested=true 2023-10-29 23:55:06,539 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f4685077c709633cc85813f6672ca901 in 1246ms, sequenceid=24, compaction requested=true 2023-10-29 23:55:06,539 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:06,539 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:06,539 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:06,539 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:06,539 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:06,539 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:06,925 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/6aae6699e54f45779914900419db8417 2023-10-29 23:55:06,929 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6aae6699e54f45779914900419db8417 2023-10-29 23:55:06,930 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/8891a9a9eb8640a18a0a61733cd49e72 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/8891a9a9eb8640a18a0a61733cd49e72 2023-10-29 23:55:06,933 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8891a9a9eb8640a18a0a61733cd49e72 2023-10-29 23:55:06,933 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/8891a9a9eb8640a18a0a61733cd49e72, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 23:55:06,934 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/6aae6699e54f45779914900419db8417 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/6aae6699e54f45779914900419db8417 2023-10-29 23:55:06,937 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6aae6699e54f45779914900419db8417 2023-10-29 23:55:06,937 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/6aae6699e54f45779914900419db8417, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 23:55:06,938 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e64684f25940ad580cd493bca8b0ccb7 in 1645ms, sequenceid=24, compaction requested=true 2023-10-29 23:55:06,938 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:06,938 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:06,938 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:06,938 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:06,938 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,938 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 23:55:06,938 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 23:55:06,940 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,940 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:06,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:06,941 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,941 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:06,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:06,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:06,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:06,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:06,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 23:55:06,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@480c2940[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:06,942 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 23:55:06,942 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,946 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,946 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 23:55:06,946 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 23:55:06,946 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:06,946 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,946 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:06,947 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 23:55:06,947 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:06,947 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,947 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 23:55:06,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:06,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:06,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:06,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:06,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:06,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:06,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:06,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:06,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 23:55:06,949 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 23:55:06,949 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:06,949 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:06,949 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 23:55:06,949 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:06,952 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:06,952 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:06,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:06,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:06,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:06,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:06,952 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:06,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:06,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:06,952 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:06,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:06,953 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 23:55:06,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:06,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:06,955 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:06,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:06,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:06,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 23:55:06,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:06,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 23:55:06,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:06,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 23:55:06,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:06,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,956 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 23:55:06,956 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 23:55:06,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:06,956 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:06,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:06,956 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:07,056 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:07,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:07,057 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:07,057 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): e64684f25940ad580cd493bca8b0ccb7/family1 is initiating major compaction (all files) 2023-10-29 23:55:07,057 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:07,058 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:07,058 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of e64684f25940ad580cd493bca8b0ccb7/family1 in testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:07,058 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/8891a9a9eb8640a18a0a61733cd49e72] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp, totalSize=26.7 K 2023-10-29 23:55:07,058 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 6a094639617b4da692775e72b4ac1d56, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695801 2023-10-29 23:55:07,059 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 218cf0b723d14ff49367d56be3e7be63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:07,059 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting dfa4839734fc47d3a1f5a326a9f67ece, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:07,059 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 2ef6f913db2d4d93997af18ab767ca6f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:07,060 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 8891a9a9eb8640a18a0a61733cd49e72, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 23:55:07,071 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): e64684f25940ad580cd493bca8b0ccb7#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:07,479 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310297613dab632b349a0bca01979363d042f_del 2023-10-29 23:55:07,479 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310297613dab632b349a0bca01979363d042f_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310297613dab632b349a0bca01979363d042f_del 2023-10-29 23:55:08,291 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d94d1cfe816441d9b1f0d3c335369a7 2023-10-29 23:55:08,292 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/9d94d1cfe816441d9b1f0d3c335369a7 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/9d94d1cfe816441d9b1f0d3c335369a7 2023-10-29 23:55:08,295 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d94d1cfe816441d9b1f0d3c335369a7 2023-10-29 23:55:08,296 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e64684f25940ad580cd493bca8b0ccb7/family1 of e64684f25940ad580cd493bca8b0ccb7 into 9d94d1cfe816441d9b1f0d3c335369a7(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:08,296 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:08,296 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:08,296 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): e64684f25940ad580cd493bca8b0ccb7/family2 is initiating major compaction (all files) 2023-10-29 23:55:08,296 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:08,296 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:08,296 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of e64684f25940ad580cd493bca8b0ccb7/family2 in testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:08,297 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/6aae6699e54f45779914900419db8417] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp, totalSize=25.4 K 2023-10-29 23:55:08,297 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 293fc688f0544badb4d195374f3149c3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695801 2023-10-29 23:55:08,297 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 9c80630656ff4b44985fda82ea53a712, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:08,298 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 26851ed553204189bc1e252f1a027182, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:08,298 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 10be3d969a1e4375926a9ace1c69582d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:08,298 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 6aae6699e54f45779914900419db8417, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 23:55:08,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/8891a9a9eb8640a18a0a61733cd49e72] to archive 2023-10-29 23:55:08,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:08,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/6a094639617b4da692775e72b4ac1d56 2023-10-29 23:55:08,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/218cf0b723d14ff49367d56be3e7be63 2023-10-29 23:55:08,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/dfa4839734fc47d3a1f5a326a9f67ece 2023-10-29 23:55:08,309 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): e64684f25940ad580cd493bca8b0ccb7#family2#compaction#108 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:08,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/2ef6f913db2d4d93997af18ab767ca6f 2023-10-29 23:55:08,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/8891a9a9eb8640a18a0a61733cd49e72 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/8891a9a9eb8640a18a0a61733cd49e72 2023-10-29 23:55:08,717 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102954ccf000269347629ba87c5c39fa011a_del 2023-10-29 23:55:08,717 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102954ccf000269347629ba87c5c39fa011a_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102954ccf000269347629ba87c5c39fa011a_del 2023-10-29 23:55:09,531 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f64252b702049719dd5edfac6a40d62 2023-10-29 23:55:09,531 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/2f64252b702049719dd5edfac6a40d62 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/2f64252b702049719dd5edfac6a40d62 2023-10-29 23:55:09,535 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f64252b702049719dd5edfac6a40d62 2023-10-29 23:55:09,536 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e64684f25940ad580cd493bca8b0ccb7/family2 of e64684f25940ad580cd493bca8b0ccb7 into 2f64252b702049719dd5edfac6a40d62(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:09,536 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:09,536 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:09,536 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): dc879cf7ad8f38cb32285196def3085e/family1 is initiating major compaction (all files) 2023-10-29 23:55:09,536 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:09,536 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:09,537 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of dc879cf7ad8f38cb32285196def3085e/family1 in testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:09,537 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/454204240a9d451bae0208593bb07fb1] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp, totalSize=26.7 K 2023-10-29 23:55:09,537 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting a11b27a0bb6a47b8a108a21ced420c63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695799 2023-10-29 23:55:09,538 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 2655c4ad3e4a436f92c6daa8884d7527, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:09,538 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting a7c81bb5b3ab433f8a5a0d001b05603c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699383 2023-10-29 23:55:09,538 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 3cdf25c230f542dc824156892aad218b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:09,538 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 454204240a9d451bae0208593bb07fb1, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 23:55:09,550 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): dc879cf7ad8f38cb32285196def3085e#family1#compaction#109 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:09,557 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310296c5410c0f15143fbb18d7bad9dc42e74_del 2023-10-29 23:55:09,557 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310296c5410c0f15143fbb18d7bad9dc42e74_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296c5410c0f15143fbb18d7bad9dc42e74_del 2023-10-29 23:55:09,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/6aae6699e54f45779914900419db8417] to archive 2023-10-29 23:55:09,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:09,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/293fc688f0544badb4d195374f3149c3 2023-10-29 23:55:09,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/9c80630656ff4b44985fda82ea53a712 2023-10-29 23:55:09,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/26851ed553204189bc1e252f1a027182 2023-10-29 23:55:09,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/10be3d969a1e4375926a9ace1c69582d 2023-10-29 23:55:09,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/6aae6699e54f45779914900419db8417 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/6aae6699e54f45779914900419db8417 2023-10-29 23:55:10,370 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f33cfbf786d748c4a97ee5e2c7aa6f68 2023-10-29 23:55:10,371 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/f33cfbf786d748c4a97ee5e2c7aa6f68 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/f33cfbf786d748c4a97ee5e2c7aa6f68 2023-10-29 23:55:10,375 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f33cfbf786d748c4a97ee5e2c7aa6f68 2023-10-29 23:55:10,376 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dc879cf7ad8f38cb32285196def3085e/family1 of dc879cf7ad8f38cb32285196def3085e into f33cfbf786d748c4a97ee5e2c7aa6f68(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:10,376 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:10,376 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:10,376 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): dc879cf7ad8f38cb32285196def3085e/family2 is initiating major compaction (all files) 2023-10-29 23:55:10,376 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:10,376 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:10,376 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of dc879cf7ad8f38cb32285196def3085e/family2 in testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:10,376 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/8c68656730c34b96b77ee1c6a3878c49] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp, totalSize=25.4 K 2023-10-29 23:55:10,377 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 714febe945864f84ad7ec8c51ebc770a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695799 2023-10-29 23:55:10,377 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 37a7c8481f714189932cc8f93bd12632, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:10,377 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 5cb3c2e412bd4a8b84a4d2e3cd136d0e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699383 2023-10-29 23:55:10,378 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting c983ae66781e457181f10a4c988b1033, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:10,378 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 8c68656730c34b96b77ee1c6a3878c49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 23:55:10,388 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): dc879cf7ad8f38cb32285196def3085e#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:10,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/454204240a9d451bae0208593bb07fb1] to archive 2023-10-29 23:55:10,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:10,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a11b27a0bb6a47b8a108a21ced420c63 2023-10-29 23:55:10,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/2655c4ad3e4a436f92c6daa8884d7527 2023-10-29 23:55:10,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/a7c81bb5b3ab433f8a5a0d001b05603c 2023-10-29 23:55:10,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/3cdf25c230f542dc824156892aad218b 2023-10-29 23:55:10,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/454204240a9d451bae0208593bb07fb1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/454204240a9d451bae0208593bb07fb1 2023-10-29 23:55:10,796 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029bd28e4027c684db98be65e3b9ade9f82_del 2023-10-29 23:55:10,797 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029bd28e4027c684db98be65e3b9ade9f82_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029bd28e4027c684db98be65e3b9ade9f82_del 2023-10-29 23:55:11,630 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa7dfe147e984eb08141da54d70df166 2023-10-29 23:55:11,630 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/aa7dfe147e984eb08141da54d70df166 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/aa7dfe147e984eb08141da54d70df166 2023-10-29 23:55:11,634 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa7dfe147e984eb08141da54d70df166 2023-10-29 23:55:11,635 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dc879cf7ad8f38cb32285196def3085e/family2 of dc879cf7ad8f38cb32285196def3085e into aa7dfe147e984eb08141da54d70df166(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:11,635 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:11,635 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:11,635 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): f4685077c709633cc85813f6672ca901/family1 is initiating major compaction (all files) 2023-10-29 23:55:11,635 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:11,635 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:11,635 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of f4685077c709633cc85813f6672ca901/family1 in testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:11,635 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/9c6c70ccdbc34d02b5d48b5b92575e7f] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp, totalSize=26.7 K 2023-10-29 23:55:11,636 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 75b0e82e07c345d0aebf3ac3bee9f997, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695800 2023-10-29 23:55:11,636 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 829873d2eebf4b5f984fac02d207f42b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:11,636 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 8632d275427e465dad17149751af6be7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:11,637 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 078d3d83e36a4d5ebb9f5cabc4aa52c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:11,637 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 9c6c70ccdbc34d02b5d48b5b92575e7f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 23:55:11,647 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): f4685077c709633cc85813f6672ca901#family1#compaction#111 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:11,654 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023102988b3cd74582846b88ca7823b95c86ce9_del 2023-10-29 23:55:11,654 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102988b3cd74582846b88ca7823b95c86ce9_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102988b3cd74582846b88ca7823b95c86ce9_del 2023-10-29 23:55:11,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/8c68656730c34b96b77ee1c6a3878c49] to archive 2023-10-29 23:55:11,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:11,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/714febe945864f84ad7ec8c51ebc770a 2023-10-29 23:55:11,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/37a7c8481f714189932cc8f93bd12632 2023-10-29 23:55:11,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/5cb3c2e412bd4a8b84a4d2e3cd136d0e 2023-10-29 23:55:11,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/c983ae66781e457181f10a4c988b1033 2023-10-29 23:55:11,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/8c68656730c34b96b77ee1c6a3878c49 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/8c68656730c34b96b77ee1c6a3878c49 2023-10-29 23:55:12,466 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7173f99c9d404f24b30c3e7ec8966958 2023-10-29 23:55:12,467 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/7173f99c9d404f24b30c3e7ec8966958 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/7173f99c9d404f24b30c3e7ec8966958 2023-10-29 23:55:12,472 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7173f99c9d404f24b30c3e7ec8966958 2023-10-29 23:55:12,473 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f4685077c709633cc85813f6672ca901/family1 of f4685077c709633cc85813f6672ca901 into 7173f99c9d404f24b30c3e7ec8966958(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:12,473 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:12,473 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:12,473 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): f4685077c709633cc85813f6672ca901/family2 is initiating major compaction (all files) 2023-10-29 23:55:12,473 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:12,473 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:12,473 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of f4685077c709633cc85813f6672ca901/family2 in testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:12,473 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/41e706d6635e4434a26c8fadacd20a93] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp, totalSize=25.4 K 2023-10-29 23:55:12,474 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 9de024002acd4492bd34872e8c74ef2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695800 2023-10-29 23:55:12,474 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 9d51fae5a73d4c919eebe6a25c8d94a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:12,474 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 1472ed6ac3ea4e819d399c51690dcc41, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:12,475 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 0bdb82b92ee64389904f8a330571af37, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:12,475 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 41e706d6635e4434a26c8fadacd20a93, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 23:55:12,486 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): f4685077c709633cc85813f6672ca901#family2#compaction#112 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:12,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/9c6c70ccdbc34d02b5d48b5b92575e7f] to archive 2023-10-29 23:55:12,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:12,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/75b0e82e07c345d0aebf3ac3bee9f997 2023-10-29 23:55:12,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/829873d2eebf4b5f984fac02d207f42b 2023-10-29 23:55:12,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/8632d275427e465dad17149751af6be7 2023-10-29 23:55:12,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/078d3d83e36a4d5ebb9f5cabc4aa52c2 2023-10-29 23:55:12,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/9c6c70ccdbc34d02b5d48b5b92575e7f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/9c6c70ccdbc34d02b5d48b5b92575e7f 2023-10-29 23:55:12,895 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023102988326517e1fa4d8fbcbd5903c4dcd4a3_del 2023-10-29 23:55:12,895 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102988326517e1fa4d8fbcbd5903c4dcd4a3_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102988326517e1fa4d8fbcbd5903c4dcd4a3_del 2023-10-29 23:55:13,709 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bfe3580525d4dc8934a70686e5f1faa 2023-10-29 23:55:13,710 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/8bfe3580525d4dc8934a70686e5f1faa as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/8bfe3580525d4dc8934a70686e5f1faa 2023-10-29 23:55:13,713 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bfe3580525d4dc8934a70686e5f1faa 2023-10-29 23:55:13,714 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f4685077c709633cc85813f6672ca901/family2 of f4685077c709633cc85813f6672ca901 into 8bfe3580525d4dc8934a70686e5f1faa(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:13,714 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:13,719 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:13,722 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:13,726 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:13,727 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:13,734 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 23:55:13,765 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-29 23:55:13,769 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310296c5410c0f15143fbb18d7bad9dc42e74_del 2023-10-29 23:55:13,772 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023102988b3cd74582846b88ca7823b95c86ce9_del 2023-10-29 23:55:13,775 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310297613dab632b349a0bca01979363d042f_del 2023-10-29 23:55:13,775 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:13,776 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(139): Connect 0x150eb27f to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:55:13,780 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f619257, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:55:13,780 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:13,781 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:13,781 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:13,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/41e706d6635e4434a26c8fadacd20a93] to archive 2023-10-29 23:55:13,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:13,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9de024002acd4492bd34872e8c74ef2b 2023-10-29 23:55:13,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/9d51fae5a73d4c919eebe6a25c8d94a5 2023-10-29 23:55:13,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/1472ed6ac3ea4e819d399c51690dcc41 2023-10-29 23:55:13,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/0bdb82b92ee64389904f8a330571af37 2023-10-29 23:55:13,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/41e706d6635e4434a26c8fadacd20a93 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/41e706d6635e4434a26c8fadacd20a93 2023-10-29 23:55:14,643 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310293e439f4955eb4636938a18e9b439eff7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293e439f4955eb4636938a18e9b439eff7 2023-10-29 23:55:14,644 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:14,646 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029cc4d43666d3d4654921d5b3c786882fd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029cc4d43666d3d4654921d5b3c786882fd 2023-10-29 23:55:14,647 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:14,647 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029ad893f73fe9d4152ba39f93a390a3c98 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ad893f73fe9d4152ba39f93a390a3c98 2023-10-29 23:55:14,648 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:14,660 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:55:14,664 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:55:14,670 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:55:14,674 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:55:14,696 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b009ffd6730b44fa8cb83e2dc16c6809 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-29 23:55:14,697 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-29 23:55:14,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b009ffd6730b44fa8cb83e2dc16c6809}] 2023-10-29 23:55:14,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/54157cadcda349e4a61ca5a084075de4 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-29 23:55:14,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c7cf35ec27ed4ae4ae8898f74a3b7585}] 2023-10-29 23:55:14,701 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/54157cadcda349e4a61ca5a084075de4}] 2023-10-29 23:55:14,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b009ffd6730b44fa8cb83e2dc16c6809 for inclusion in e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:55:14,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/54157cadcda349e4a61ca5a084075de4 for inclusion in dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:55:14,707 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 for inclusion in f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:55:14,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-29 23:55:14,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 23:55:14,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:14,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-29 23:55:14,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 23:55:14,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-29 23:55:14,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 23:55:14,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:14,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:14,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b009ffd6730b44fa8cb83e2dc16c6809 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__r1k9ccdd1etaqnng3ipu8ckd73t2vnbsr47jqg7ok7kkbccjqfa0kksike6q6g21/family1/b009ffd6730b44fa8cb83e2dc16c6809 2023-10-29 23:55:14,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/54157cadcda349e4a61ca5a084075de4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__kauurp8flgsf4k6lhu2gm0cbja9rd06r8sqlk842flomugchb2cnl3da92ksjls1/family1/54157cadcda349e4a61ca5a084075de4 2023-10-29 23:55:14,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__f0mpkslaj21cvr1s7q8mvud4ujc3q1abhm3kqnn6k8fqhcbh11vveg4qhagcjaeq/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 2023-10-29 23:55:14,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__r1k9ccdd1etaqnng3ipu8ckd73t2vnbsr47jqg7ok7kkbccjqfa0kksike6q6g21/family1/b009ffd6730b44fa8cb83e2dc16c6809 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_ 2023-10-29 23:55:14,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__r1k9ccdd1etaqnng3ipu8ckd73t2vnbsr47jqg7ok7kkbccjqfa0kksike6q6g21/family1/b009ffd6730b44fa8cb83e2dc16c6809 into e64684f25940ad580cd493bca8b0ccb7/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_ - updating store file list. 2023-10-29 23:55:14,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__kauurp8flgsf4k6lhu2gm0cbja9rd06r8sqlk842flomugchb2cnl3da92ksjls1/family1/54157cadcda349e4a61ca5a084075de4 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_ 2023-10-29 23:55:14,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__f0mpkslaj21cvr1s7q8mvud4ujc3q1abhm3kqnn6k8fqhcbh11vveg4qhagcjaeq/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_ 2023-10-29 23:55:14,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__kauurp8flgsf4k6lhu2gm0cbja9rd06r8sqlk842flomugchb2cnl3da92ksjls1/family1/54157cadcda349e4a61ca5a084075de4 into dc879cf7ad8f38cb32285196def3085e/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_ - updating store file list. 2023-10-29 23:55:14,715 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__f0mpkslaj21cvr1s7q8mvud4ujc3q1abhm3kqnn6k8fqhcbh11vveg4qhagcjaeq/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 into f4685077c709633cc85813f6672ca901/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_ - updating store file list. 2023-10-29 23:55:14,718 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_ into e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:55:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__r1k9ccdd1etaqnng3ipu8ckd73t2vnbsr47jqg7ok7kkbccjqfa0kksike6q6g21/family1/b009ffd6730b44fa8cb83e2dc16c6809 into e64684f25940ad580cd493bca8b0ccb7/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_) 2023-10-29 23:55:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_ into f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:55:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__f0mpkslaj21cvr1s7q8mvud4ujc3q1abhm3kqnn6k8fqhcbh11vveg4qhagcjaeq/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 into f4685077c709633cc85813f6672ca901/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_) 2023-10-29 23:55:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_ into dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:55:14,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__kauurp8flgsf4k6lhu2gm0cbja9rd06r8sqlk842flomugchb2cnl3da92ksjls1/family1/54157cadcda349e4a61ca5a084075de4 into dc879cf7ad8f38cb32285196def3085e/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_) 2023-10-29 23:55:14,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__r1k9ccdd1etaqnng3ipu8ckd73t2vnbsr47jqg7ok7kkbccjqfa0kksike6q6g21/family1/b009ffd6730b44fa8cb83e2dc16c6809 2023-10-29 23:55:14,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__f0mpkslaj21cvr1s7q8mvud4ujc3q1abhm3kqnn6k8fqhcbh11vveg4qhagcjaeq/family1/c7cf35ec27ed4ae4ae8898f74a3b7585 2023-10-29 23:55:14,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__kauurp8flgsf4k6lhu2gm0cbja9rd06r8sqlk842flomugchb2cnl3da92ksjls1/family1/54157cadcda349e4a61ca5a084075de4 2023-10-29 23:55:14,723 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:14,723 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:14,724 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:14,724 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:14,724 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:14,725 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:14,726 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 2023-10-29 23:55:14,727 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 2023-10-29 23:55:14,727 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 2023-10-29 23:55:14,728 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b 2023-10-29 23:55:14,729 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 2023-10-29 23:55:14,730 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac 2023-10-29 23:55:14,730 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f 2023-10-29 23:55:14,731 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c 2023-10-29 23:55:14,732 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 2023-10-29 23:55:14,732 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd 2023-10-29 23:55:14,732 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 23:55:14,732 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 23:55:14,733 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:14,734 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 2023-10-29 23:55:14,734 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 23:55:14,734 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 23:55:14,735 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:14,735 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 2023-10-29 23:55:14,735 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 23:55:14,735 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 23:55:14,736 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:14,736 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:14,736 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:14,736 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296c5410c0f15143fbb18d7bad9dc42e74_del] 2023-10-29 23:55:14,737 DEBUG [Listener at localhost/45261] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:14,738 DEBUG [Listener at localhost/45261] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296c5410c0f15143fbb18d7bad9dc42e74_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310296c5410c0f15143fbb18d7bad9dc42e74_del 2023-10-29 23:55:14,738 INFO [Listener at localhost/45261] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 23:55:14,738 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102988b3cd74582846b88ca7823b95c86ce9_del] 2023-10-29 23:55:14,739 DEBUG [Listener at localhost/45261] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:14,741 DEBUG [Listener at localhost/45261] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102988b3cd74582846b88ca7823b95c86ce9_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102988b3cd74582846b88ca7823b95c86ce9_del 2023-10-29 23:55:14,742 INFO [Listener at localhost/45261] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 23:55:14,742 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310297613dab632b349a0bca01979363d042f_del] 2023-10-29 23:55:14,742 DEBUG [Listener at localhost/45261] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:14,744 DEBUG [Listener at localhost/45261] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310297613dab632b349a0bca01979363d042f_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310297613dab632b349a0bca01979363d042f_del 2023-10-29 23:55:14,744 INFO [Listener at localhost/45261] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 23:55:14,747 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:14,750 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:14,753 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:14,754 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:14,762 INFO [Listener at localhost/45261] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-10-29 23:55:14,763 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-10-29 23:55:14,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-10-29 23:55:14,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 23:55:14,767 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623714767"}]},"ts":"1698623714767"} 2023-10-29 23:55:14,769 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-10-29 23:55:14,771 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-10-29 23:55:14,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, UNASSIGN}] 2023-10-29 23:55:14,773 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, UNASSIGN 2023-10-29 23:55:14,773 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, UNASSIGN 2023-10-29 23:55:14,773 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, UNASSIGN 2023-10-29 23:55:14,774 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=dc879cf7ad8f38cb32285196def3085e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:14,774 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e64684f25940ad580cd493bca8b0ccb7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:14,774 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623714774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623714774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623714774"}]},"ts":"1698623714774"} 2023-10-29 23:55:14,774 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=f4685077c709633cc85813f6672ca901, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:14,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623714774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623714774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623714774"}]},"ts":"1698623714774"} 2023-10-29 23:55:14,774 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623714774"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623714774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623714774"}]},"ts":"1698623714774"} 2023-10-29 23:55:14,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure dc879cf7ad8f38cb32285196def3085e, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:14,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure e64684f25940ad580cd493bca8b0ccb7, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:14,777 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure f4685077c709633cc85813f6672ca901, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:14,825 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,40533,1698623599827, timeout=1698623714927, delay=102, operations=[pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure f4685077c709633cc85813f6672ca901, server=jenkins-hbase4.apache.org,40533,1698623599827, pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure e64684f25940ad580cd493bca8b0ccb7, server=jenkins-hbase4.apache.org,40533,1698623599827, pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure dc879cf7ad8f38cb32285196def3085e, server=jenkins-hbase4.apache.org,40533,1698623599827]] 2023-10-29 23:55:14,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 23:55:14,927 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:14,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f4685077c709633cc85813f6672ca901 2023-10-29 23:55:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4685077c709633cc85813f6672ca901, disabling compactions & flushes 2023-10-29 23:55:14,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. after waiting 0 ms 2023-10-29 23:55:14,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:14,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 23:55:14,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:14,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:14,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f4685077c709633cc85813f6672ca901 2023-10-29 23:55:14,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:14,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e64684f25940ad580cd493bca8b0ccb7, disabling compactions & flushes 2023-10-29 23:55:14,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:14,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:14,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. after waiting 0 ms 2023-10-29 23:55:14,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:14,938 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=f4685077c709633cc85813f6672ca901, regionState=CLOSED 2023-10-29 23:55:14,939 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623714938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623714938"}]},"ts":"1698623714938"} 2023-10-29 23:55:14,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=90 2023-10-29 23:55:14,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure f4685077c709633cc85813f6672ca901, server=jenkins-hbase4.apache.org,40533,1698623599827 in 163 msec 2023-10-29 23:55:14,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, UNASSIGN in 171 msec 2023-10-29 23:55:14,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 23:55:14,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:14,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:14,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:14,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:14,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc879cf7ad8f38cb32285196def3085e, disabling compactions & flushes 2023-10-29 23:55:14,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:14,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:14,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. after waiting 0 ms 2023-10-29 23:55:14,949 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e64684f25940ad580cd493bca8b0ccb7, regionState=CLOSED 2023-10-29 23:55:14,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:14,949 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623714949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623714949"}]},"ts":"1698623714949"} 2023-10-29 23:55:14,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-29 23:55:14,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure e64684f25940ad580cd493bca8b0ccb7, server=jenkins-hbase4.apache.org,40533,1698623599827 in 175 msec 2023-10-29 23:55:14,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, UNASSIGN in 183 msec 2023-10-29 23:55:14,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 23:55:14,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:14,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:14,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:14,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=dc879cf7ad8f38cb32285196def3085e, regionState=CLOSED 2023-10-29 23:55:14,959 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623714959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623714959"}]},"ts":"1698623714959"} 2023-10-29 23:55:14,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=89 2023-10-29 23:55:14,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure dc879cf7ad8f38cb32285196def3085e, server=jenkins-hbase4.apache.org,40533,1698623599827 in 185 msec 2023-10-29 23:55:14,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-10-29 23:55:14,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, UNASSIGN in 191 msec 2023-10-29 23:55:14,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623714964"}]},"ts":"1698623714964"} 2023-10-29 23:55:14,965 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-10-29 23:55:14,967 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-10-29 23:55:14,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 204 msec 2023-10-29 23:55:15,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 23:55:15,068 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-10-29 23:55:15,078 INFO [Listener at localhost/45261] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:15,079 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 23:55:15,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698623715079 (current time:1698623715079). 2023-10-29 23:55:15,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-29 23:55:15,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] zookeeper.ReadOnlyZKClient(139): Connect 0x4760c5ce to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:55:15,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26bb1a9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:55:15,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:55:15,089 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:55:15,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4760c5ce to 127.0.0.1:50259 2023-10-29 23:55:15,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:15,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-29 23:55:15,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 23:55:15,092 WARN [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot, current working dir path: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698623702946-1698623715078 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-29 23:55:15,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 23:55:15,094 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 23:55:15,095 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698624315095 2023-10-29 23:55:15,095 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698623702946-1698623715078 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-29 23:55:15,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 23:55:15,095 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:15,095 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-29 23:55:15,195 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:15,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:15,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:15,196 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-29 23:55:15,396 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:15,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:15,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:15,398 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-29 23:55:15,501 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 23:55:15,503 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 23:55:15,506 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/9d94d1cfe816441d9b1f0d3c335369a7] hfiles 2023-10-29 23:55:15,506 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/f33cfbf786d748c4a97ee5e2c7aa6f68] hfiles 2023-10-29 23:55:15,506 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_ 2023-10-29 23:55:15,506 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/7173f99c9d404f24b30c3e7ec8966958, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_] hfiles 2023-10-29 23:55:15,506 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/9d94d1cfe816441d9b1f0d3c335369a7 2023-10-29 23:55:15,506 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/7173f99c9d404f24b30c3e7ec8966958 2023-10-29 23:55:15,506 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_ 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_ 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/f33cfbf786d748c4a97ee5e2c7aa6f68 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029cc4d43666d3d4654921d5b3c786882fd, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ad893f73fe9d4152ba39f93a390a3c98, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293e439f4955eb4636938a18e9b439eff7] hfiles 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029cc4d43666d3d4654921d5b3c786882fd 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ad893f73fe9d4152ba39f93a390a3c98 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293e439f4955eb4636938a18e9b439eff7 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/2f64252b702049719dd5edfac6a40d62] hfiles 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/2f64252b702049719dd5edfac6a40d62 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/aa7dfe147e984eb08141da54d70df166] hfiles 2023-10-29 23:55:15,507 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/8bfe3580525d4dc8934a70686e5f1faa] hfiles 2023-10-29 23:55:15,508 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/aa7dfe147e984eb08141da54d70df166 2023-10-29 23:55:15,508 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/8bfe3580525d4dc8934a70686e5f1faa 2023-10-29 23:55:15,515 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295cf6e7f525934fceb2a7ed45789e03d3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102988326517e1fa4d8fbcbd5903c4dcd4a3_del, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029df425f60cc354809bf32b7feb0108c48, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029e0cc12f4b6c64ab69d82c50bbd51f559, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ee1187e24b7f4926b3c8b6b25ca6a006, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291e5b41c34eea40f7bca751515066122f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102954ccf000269347629ba87c5c39fa011a_del, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310295bfbded4a2ea4ec1b78b0a9498c66fd7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297dd11a0245aa4a0ea47ad46d782af8ad, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297ebce1f5ccfc45b39951ae61b51f13b6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029249df982251047c29a7c11bb3b3408ef, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293462a81649ce4106819d25d72f166a60, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310294374e64a29d5472cad15c920780919a0, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029bd28e4027c684db98be65e3b9ade9f82_del, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d7b332a8a0224ccd80992fe4d8ffc880] hfiles 2023-10-29 23:55:15,515 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295cf6e7f525934fceb2a7ed45789e03d3 2023-10-29 23:55:15,515 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102988326517e1fa4d8fbcbd5903c4dcd4a3_del 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029df425f60cc354809bf32b7feb0108c48 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029e0cc12f4b6c64ab69d82c50bbd51f559 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ee1187e24b7f4926b3c8b6b25ca6a006 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291e5b41c34eea40f7bca751515066122f 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102954ccf000269347629ba87c5c39fa011a_del 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310295bfbded4a2ea4ec1b78b0a9498c66fd7 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297dd11a0245aa4a0ea47ad46d782af8ad 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310297ebce1f5ccfc45b39951ae61b51f13b6 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029249df982251047c29a7c11bb3b3408ef 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293462a81649ce4106819d25d72f166a60 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310294374e64a29d5472cad15c920780919a0 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029bd28e4027c684db98be65e3b9ade9f82_del 2023-10-29 23:55:15,516 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d7b332a8a0224ccd80992fe4d8ffc880 2023-10-29 23:55:15,698 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:15,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:15,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:15,700 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-29 23:55:15,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-10-29 23:55:15,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:15,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:16,200 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:16,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:16,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 23:55:16,201 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-29 23:55:16,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698623702946-1698623715078 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:16,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698623702946-1698623715078 of table testCompactionWithHFileLink completed 2023-10-29 23:55:16,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:16,339 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:16,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698623702946-1698623715078 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698623715095Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698623715501 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698623702946-1698623715078 at 1698623715915 (+414 ms)Loading Region manifests for hbase-failsafe-snaptb-1698623702946-1698623715078 at 1698623715915Writing data manifest for hbase-failsafe-snaptb-1698623702946-1698623715078 at 1698623715918 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1698623702946-1698623715078 at 1698623716325 (+407 ms)Snapshot hbase-failsafe-snaptb-1698623702946-1698623715078 of table testCompactionWithHFileLink completed at 1698623716339 (+14 ms) 2023-10-29 23:55:16,340 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 23:55:16,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2470 sec 2023-10-29 23:55:17,201 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 23:55:17,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 23:55:17,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698623702946-1698623715078 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-29 23:55:17,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698623702946" table: "testCompactionWithHFileLink" creation_time: 1698623703108 type: FLUSH version: 2 ttl: 0 ) 2023-10-29 23:55:17,239 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698623702946 as table=testCompactionWithHFileLink 2023-10-29 23:55:17,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 23:55:17,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 23:55:17,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 23:55:17,648 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-29 23:55:17,649 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-29 23:55:17,649 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-29 23:55:17,650 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 23:55:17,655 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698623702946" table: "testCompactionWithHFileLink" creation_time: 1698623703108 type: FLUSH version: 2 ttl: 0 2023-10-29 23:55:17,656 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink 2023-10-29 23:55:17,660 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-10-29 23:55:17,663 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029cc4d43666d3d4654921d5b3c786882fd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029cc4d43666d3d4654921d5b3c786882fd 2023-10-29 23:55:17,665 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ad893f73fe9d4152ba39f93a390a3c98 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ad893f73fe9d4152ba39f93a390a3c98 2023-10-29 23:55:17,666 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293e439f4955eb4636938a18e9b439eff7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293e439f4955eb4636938a18e9b439eff7 2023-10-29 23:55:17,666 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,669 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,672 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,674 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,677 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,680 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,682 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,685 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,688 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,690 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,693 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,696 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 of snapshot=snaptb-1698623702946 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 23:55:17,700 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102988326517e1fa4d8fbcbd5903c4dcd4a3_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102988326517e1fa4d8fbcbd5903c4dcd4a3_del 2023-10-29 23:55:17,701 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102954ccf000269347629ba87c5c39fa011a_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102954ccf000269347629ba87c5c39fa011a_del 2023-10-29 23:55:17,703 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029bd28e4027c684db98be65e3b9ade9f82_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029bd28e4027c684db98be65e3b9ade9f82_del 2023-10-29 23:55:17,703 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:17,703 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:17,703 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: f4685077c709633cc85813f6672ca901 2023-10-29 23:55:17,706 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/f33cfbf786d748c4a97ee5e2c7aa6f68 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/f33cfbf786d748c4a97ee5e2c7aa6f68 2023-10-29 23:55:17,706 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/326e66f528de4a7bae34eeedcefc542d_SeqId_29_ 2023-10-29 23:55:17,707 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/7173f99c9d404f24b30c3e7ec8966958 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/7173f99c9d404f24b30c3e7ec8966958 2023-10-29 23:55:17,708 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/80d874b1a46e4b4e9cb148e8eb63d9d3_SeqId_29_ 2023-10-29 23:55:17,708 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a11b27a0bb6a47b8a108a21ced420c63 of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,708 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/9d94d1cfe816441d9b1f0d3c335369a7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/9d94d1cfe816441d9b1f0d3c335369a7 2023-10-29 23:55:17,708 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6a094639617b4da692775e72b4ac1d56 of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,708 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/f7269550f1cf4c7c8ad7e1bbe83e3c78_SeqId_29_ 2023-10-29 23:55:17,708 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 75b0e82e07c345d0aebf3ac3bee9f997 of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,714 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2655c4ad3e4a436f92c6daa8884d7527 of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,715 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 218cf0b723d14ff49367d56be3e7be63 of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,715 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 829873d2eebf4b5f984fac02d207f42b of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,725 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8632d275427e465dad17149751af6be7 of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,725 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a7c81bb5b3ab433f8a5a0d001b05603c of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,725 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dfa4839734fc47d3a1f5a326a9f67ece of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,733 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3cdf25c230f542dc824156892aad218b of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,733 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 078d3d83e36a4d5ebb9f5cabc4aa52c2 of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,733 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2ef6f913db2d4d93997af18ab767ca6f of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,739 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/aa7dfe147e984eb08141da54d70df166 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/aa7dfe147e984eb08141da54d70df166 2023-10-29 23:55:17,739 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 714febe945864f84ad7ec8c51ebc770a of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,739 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/8bfe3580525d4dc8934a70686e5f1faa to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/8bfe3580525d4dc8934a70686e5f1faa 2023-10-29 23:55:17,739 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9de024002acd4492bd34872e8c74ef2b of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,739 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/2f64252b702049719dd5edfac6a40d62 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/2f64252b702049719dd5edfac6a40d62 2023-10-29 23:55:17,739 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 293fc688f0544badb4d195374f3149c3 of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,743 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9d51fae5a73d4c919eebe6a25c8d94a5 of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,744 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 37a7c8481f714189932cc8f93bd12632 of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,745 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9c80630656ff4b44985fda82ea53a712 of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,747 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1472ed6ac3ea4e819d399c51690dcc41 of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,748 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5cb3c2e412bd4a8b84a4d2e3cd136d0e of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,749 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 26851ed553204189bc1e252f1a027182 of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,751 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0bdb82b92ee64389904f8a330571af37 of snapshot=snaptb-1698623702946 to region=f4685077c709633cc85813f6672ca901 table=testCompactionWithHFileLink 2023-10-29 23:55:17,752 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c983ae66781e457181f10a4c988b1033 of snapshot=snaptb-1698623702946 to region=dc879cf7ad8f38cb32285196def3085e table=testCompactionWithHFileLink 2023-10-29 23:55:17,753 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 10be3d969a1e4375926a9ace1c69582d of snapshot=snaptb-1698623702946 to region=e64684f25940ad580cd493bca8b0ccb7 table=testCompactionWithHFileLink 2023-10-29 23:55:17,757 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698623702946" table: "testCompactionWithHFileLink" creation_time: 1698623703108 type: FLUSH version: 2 ttl: 0 2023-10-29 23:55:17,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698623717758"}]},"ts":"9223372036854775807"} 2023-10-29 23:55:17,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698623717758"}]},"ts":"9223372036854775807"} 2023-10-29 23:55:17,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698623717758"}]},"ts":"9223372036854775807"} 2023-10-29 23:55:17,760 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-10-29 23:55:17,760 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dc879cf7ad8f38cb32285196def3085e, NAME => 'testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e64684f25940ad580cd493bca8b0ccb7, NAME => 'testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f4685077c709633cc85813f6672ca901, NAME => 'testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-29 23:55:17,760 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623717759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623717759"}]},"ts":"1698623717759"} 2023-10-29 23:55:17,760 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623717759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623717759"}]},"ts":"1698623717759"} 2023-10-29 23:55:17,760 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623717759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623717759"}]},"ts":"1698623717759"} 2023-10-29 23:55:17,762 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 23:55:17,762 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-10-29 23:55:17,762 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => dc879cf7ad8f38cb32285196def3085e, NAME => 'testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e64684f25940ad580cd493bca8b0ccb7, NAME => 'testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f4685077c709633cc85813f6672ca901, NAME => 'testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-29 23:55:17,763 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698623702946 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-10-29 23:55:17,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698623702946" table: "testCompactionWithHFileLink" creation_time: 1698623703108 type: FLUSH version: 2 ttl: 0 ) in 533 msec 2023-10-29 23:55:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 23:55:17,845 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-10-29 23:55:17,845 INFO [Listener at localhost/45261] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:17,850 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1698623702946-1698623715078" 2023-10-29 23:55:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698623702946-1698623715078 2023-10-29 23:55:17,856 INFO [Listener at localhost/45261] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-10-29 23:55:17,861 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-10-29 23:55:17,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-10-29 23:55:17,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 23:55:17,871 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-10-29 23:55:17,871 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623717871"}]},"ts":"1698623717871"} 2023-10-29 23:55:17,872 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-29 23:55:17,875 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-10-29 23:55:17,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN}] 2023-10-29 23:55:17,877 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN 2023-10-29 23:55:17,877 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN 2023-10-29 23:55:17,877 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN 2023-10-29 23:55:17,877 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 23:55:17,884 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 23:55:17,884 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 23:55:17,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 23:55:18,029 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e64684f25940ad580cd493bca8b0ccb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:18,029 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=dc879cf7ad8f38cb32285196def3085e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:18,029 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=f4685077c709633cc85813f6672ca901, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:18,029 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623718029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623718029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623718029"}]},"ts":"1698623718029"} 2023-10-29 23:55:18,029 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623718029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623718029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623718029"}]},"ts":"1698623718029"} 2023-10-29 23:55:18,029 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623718029"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623718029"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623718029"}]},"ts":"1698623718029"} 2023-10-29 23:55:18,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure e64684f25940ad580cd493bca8b0ccb7, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:18,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure f4685077c709633cc85813f6672ca901, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:18,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure dc879cf7ad8f38cb32285196def3085e, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 23:55:18,184 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:18,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:18,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e64684f25940ad580cd493bca8b0ccb7, NAME => 'testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 23:55:18,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:18,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,188 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,189 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:55:18,189 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:55:18,189 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64684f25940ad580cd493bca8b0ccb7 columnFamilyName family1 2023-10-29 23:55:18,198 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-218cf0b723d14ff49367d56be3e7be63 2023-10-29 23:55:18,203 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-2ef6f913db2d4d93997af18ab767ca6f 2023-10-29 23:55:18,209 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-6a094639617b4da692775e72b4ac1d56 2023-10-29 23:55:18,214 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-dfa4839734fc47d3a1f5a326a9f67ece 2023-10-29 23:55:18,214 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(310): Store=e64684f25940ad580cd493bca8b0ccb7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:18,214 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,215 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2 2023-10-29 23:55:18,215 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2 2023-10-29 23:55:18,215 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64684f25940ad580cd493bca8b0ccb7 columnFamilyName family2 2023-10-29 23:55:18,221 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-10be3d969a1e4375926a9ace1c69582d 2023-10-29 23:55:18,226 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-26851ed553204189bc1e252f1a027182 2023-10-29 23:55:18,230 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-293fc688f0544badb4d195374f3149c3 2023-10-29 23:55:18,234 DEBUG [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-9c80630656ff4b44985fda82ea53a712 2023-10-29 23:55:18,234 INFO [StoreOpener-e64684f25940ad580cd493bca8b0ccb7-1] regionserver.HStore(310): Store=e64684f25940ad580cd493bca8b0ccb7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:18,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:18,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:55:18,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e64684f25940ad580cd493bca8b0ccb7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73289220, jitterRate=0.09209448099136353}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:18,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:18,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7., pid=101, masterSystemTime=1698623718184 2023-10-29 23:55:18,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:18,240 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 23:55:18,240 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 23:55:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:18,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:18,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:18,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:18,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4685077c709633cc85813f6672ca901, NAME => 'testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 23:55:18,242 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e64684f25940ad580cd493bca8b0ccb7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:18,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,242 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623718241"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623718241"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623718241"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623718241"}]},"ts":"1698623718241"} 2023-10-29 23:55:18,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:18,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,242 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 23:55:18,242 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1912): e64684f25940ad580cd493bca8b0ccb7/family1 is initiating minor compaction (all files) 2023-10-29 23:55:18,242 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 23:55:18,242 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e64684f25940ad580cd493bca8b0ccb7/family1 in testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:18,242 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1912): e64684f25940ad580cd493bca8b0ccb7/family2 is initiating minor compaction (all files) 2023-10-29 23:55:18,242 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-6a094639617b4da692775e72b4ac1d56, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-218cf0b723d14ff49367d56be3e7be63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-dfa4839734fc47d3a1f5a326a9f67ece, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-2ef6f913db2d4d93997af18ab767ca6f] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp, totalSize=21.6 K 2023-10-29 23:55:18,242 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegion(2259): Starting compaction of e64684f25940ad580cd493bca8b0ccb7/family2 in testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:55:18,243 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-293fc688f0544badb4d195374f3149c3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-9c80630656ff4b44985fda82ea53a712, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-26851ed553204189bc1e252f1a027182, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-10be3d969a1e4375926a9ace1c69582d] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp, totalSize=20.4 K 2023-10-29 23:55:18,243 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,243 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-6a094639617b4da692775e72b4ac1d56, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695801 2023-10-29 23:55:18,244 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-293fc688f0544badb4d195374f3149c3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695801 2023-10-29 23:55:18,244 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:55:18,244 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:55:18,244 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-218cf0b723d14ff49367d56be3e7be63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:18,244 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4685077c709633cc85813f6672ca901 columnFamilyName family1 2023-10-29 23:55:18,244 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-9c80630656ff4b44985fda82ea53a712, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:18,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-10-29 23:55:18,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure e64684f25940ad580cd493bca8b0ccb7, server=jenkins-hbase4.apache.org,40533,1698623599827 in 212 msec 2023-10-29 23:55:18,245 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-dfa4839734fc47d3a1f5a326a9f67ece, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:18,245 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-26851ed553204189bc1e252f1a027182, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:18,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=e64684f25940ad580cd493bca8b0ccb7, ASSIGN in 370 msec 2023-10-29 23:55:18,246 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-2ef6f913db2d4d93997af18ab767ca6f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:18,247 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-10be3d969a1e4375926a9ace1c69582d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:18,261 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-078d3d83e36a4d5ebb9f5cabc4aa52c2 2023-10-29 23:55:18,270 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-75b0e82e07c345d0aebf3ac3bee9f997 2023-10-29 23:55:18,281 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-829873d2eebf4b5f984fac02d207f42b 2023-10-29 23:55:18,291 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-8632d275427e465dad17149751af6be7 2023-10-29 23:55:18,293 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(310): Store=f4685077c709633cc85813f6672ca901/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:18,293 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] throttle.PressureAwareThroughputController(145): e64684f25940ad580cd493bca8b0ccb7#family2#compaction#113 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:18,293 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,297 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): e64684f25940ad580cd493bca8b0ccb7#family1#compaction#114 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:18,297 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2 2023-10-29 23:55:18,297 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2 2023-10-29 23:55:18,298 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4685077c709633cc85813f6672ca901 columnFamilyName family2 2023-10-29 23:55:18,312 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-0bdb82b92ee64389904f8a330571af37 2023-10-29 23:55:18,317 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-1472ed6ac3ea4e819d399c51690dcc41 2023-10-29 23:55:18,320 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family2/996eee2a0785405a8f7efc7b30a2c22a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/996eee2a0785405a8f7efc7b30a2c22a 2023-10-29 23:55:18,322 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9d51fae5a73d4c919eebe6a25c8d94a5 2023-10-29 23:55:18,325 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 23:55:18,326 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e64684f25940ad580cd493bca8b0ccb7/family2 of e64684f25940ad580cd493bca8b0ccb7 into 996eee2a0785405a8f7efc7b30a2c22a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:18,326 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:18,326 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7., storeName=e64684f25940ad580cd493bca8b0ccb7/family2, priority=12, startTime=1698623718240; duration=0sec 2023-10-29 23:55:18,326 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:18,327 DEBUG [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9de024002acd4492bd34872e8c74ef2b 2023-10-29 23:55:18,327 INFO [StoreOpener-f4685077c709633cc85813f6672ca901-1] regionserver.HStore(310): Store=f4685077c709633cc85813f6672ca901/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:18,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:18,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4685077c709633cc85813f6672ca901 2023-10-29 23:55:18,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4685077c709633cc85813f6672ca901; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71078828, jitterRate=0.05915707349777222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:18,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:18,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901., pid=102, masterSystemTime=1698623718184 2023-10-29 23:55:18,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 23:55:18,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 23:55:18,339 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 23:55:18,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:18,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:18,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:18,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc879cf7ad8f38cb32285196def3085e, NAME => 'testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 23:55:18,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=f4685077c709633cc85813f6672ca901, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:18,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623718340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623718340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623718340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623718340"}]},"ts":"1698623718340"} 2023-10-29 23:55:18,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:18,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,342 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 23:55:18,342 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1912): f4685077c709633cc85813f6672ca901/family1 is initiating minor compaction (all files) 2023-10-29 23:55:18,342 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,342 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f4685077c709633cc85813f6672ca901/family1 in testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:18,343 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-75b0e82e07c345d0aebf3ac3bee9f997, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-829873d2eebf4b5f984fac02d207f42b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-8632d275427e465dad17149751af6be7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-078d3d83e36a4d5ebb9f5cabc4aa52c2] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp, totalSize=21.6 K 2023-10-29 23:55:18,344 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-75b0e82e07c345d0aebf3ac3bee9f997, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695800 2023-10-29 23:55:18,344 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:55:18,344 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:55:18,345 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc879cf7ad8f38cb32285196def3085e columnFamilyName family1 2023-10-29 23:55:18,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-10-29 23:55:18,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure f4685077c709633cc85813f6672ca901, server=jenkins-hbase4.apache.org,40533,1698623599827 in 313 msec 2023-10-29 23:55:18,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f4685077c709633cc85813f6672ca901, ASSIGN in 472 msec 2023-10-29 23:55:18,349 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-829873d2eebf4b5f984fac02d207f42b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:18,350 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-8632d275427e465dad17149751af6be7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:18,351 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-078d3d83e36a4d5ebb9f5cabc4aa52c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:18,357 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-2655c4ad3e4a436f92c6daa8884d7527 2023-10-29 23:55:18,366 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-3cdf25c230f542dc824156892aad218b 2023-10-29 23:55:18,390 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a11b27a0bb6a47b8a108a21ced420c63 2023-10-29 23:55:18,404 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] throttle.PressureAwareThroughputController(145): f4685077c709633cc85813f6672ca901#family1#compaction#115 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:18,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-293fc688f0544badb4d195374f3149c3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-9c80630656ff4b44985fda82ea53a712, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-26851ed553204189bc1e252f1a027182, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-10be3d969a1e4375926a9ace1c69582d] to archive 2023-10-29 23:55:18,405 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a7c81bb5b3ab433f8a5a0d001b05603c 2023-10-29 23:55:18,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:18,405 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(310): Store=dc879cf7ad8f38cb32285196def3085e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:18,405 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,406 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2 2023-10-29 23:55:18,406 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2 2023-10-29 23:55:18,407 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc879cf7ad8f38cb32285196def3085e columnFamilyName family2 2023-10-29 23:55:18,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-293fc688f0544badb4d195374f3149c3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-293fc688f0544badb4d195374f3149c3 2023-10-29 23:55:18,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-9c80630656ff4b44985fda82ea53a712 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-9c80630656ff4b44985fda82ea53a712 2023-10-29 23:55:18,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-26851ed553204189bc1e252f1a027182 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-26851ed553204189bc1e252f1a027182 2023-10-29 23:55:18,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-10be3d969a1e4375926a9ace1c69582d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family2/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-10be3d969a1e4375926a9ace1c69582d 2023-10-29 23:55:18,423 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-37a7c8481f714189932cc8f93bd12632 2023-10-29 23:55:18,427 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-5cb3c2e412bd4a8b84a4d2e3cd136d0e 2023-10-29 23:55:18,433 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-714febe945864f84ad7ec8c51ebc770a 2023-10-29 23:55:18,438 DEBUG [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(539): loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-c983ae66781e457181f10a4c988b1033 2023-10-29 23:55:18,438 INFO [StoreOpener-dc879cf7ad8f38cb32285196def3085e-1] regionserver.HStore(310): Store=dc879cf7ad8f38cb32285196def3085e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:18,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:18,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:55:18,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc879cf7ad8f38cb32285196def3085e; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75145402, jitterRate=0.11975374817848206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:18,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:18,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e., pid=103, masterSystemTime=1698623718184 2023-10-29 23:55:18,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-29 23:55:18,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-29 23:55:18,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:18,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:18,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=dc879cf7ad8f38cb32285196def3085e, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:18,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698623718449"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623718449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623718449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623718449"}]},"ts":"1698623718449"} 2023-10-29 23:55:18,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-10-29 23:55:18,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure dc879cf7ad8f38cb32285196def3085e, server=jenkins-hbase4.apache.org,40533,1698623599827 in 418 msec 2023-10-29 23:55:18,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-10-29 23:55:18,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dc879cf7ad8f38cb32285196def3085e, ASSIGN in 577 msec 2023-10-29 23:55:18,454 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623718454"}]},"ts":"1698623718454"} 2023-10-29 23:55:18,455 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-29 23:55:18,458 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-10-29 23:55:18,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 595 msec 2023-10-29 23:55:18,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 23:55:18,474 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-10-29 23:55:18,484 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:18,491 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:18,499 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:18,500 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:18,507 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 23:55:18,525 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-29 23:55:18,525 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:18,526 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(139): Connect 0x399b4bc6 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:55:18,530 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ba36af0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:55:18,531 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:18,531 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:18,531 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:19,026 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029cfbc91812321419298505e20e547318f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029cfbc91812321419298505e20e547318f 2023-10-29 23:55:19,027 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029fe505429601b49ff8e7c0a31d6972324 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029fe505429601b49ff8e7c0a31d6972324 2023-10-29 23:55:19,027 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:19,028 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:19,039 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:55:19,042 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:55:19,055 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:55:19,062 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:55:19,075 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/02fcf9a39216468f82b3aba0beb43946 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-10-29 23:55:19,075 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=32 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/02fcf9a39216468f82b3aba0beb43946}] 2023-10-29 23:55:19,078 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-10-29 23:55:19,079 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4}] 2023-10-29 23:55:19,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/02fcf9a39216468f82b3aba0beb43946 for inclusion in dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:55:19,083 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 for inclusion in e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:55:19,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-10-29 23:55:19,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 23:55:19,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-10-29 23:55:19,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 23:55:19,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:19,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:19,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/02fcf9a39216468f82b3aba0beb43946 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__umam9pphnlfk9eonep15iefrfe3si43fsulvtttiilp0u66gc6c5ce453l207c3p/family1/02fcf9a39216468f82b3aba0beb43946 2023-10-29 23:55:19,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__n8lq3qeujdb673v9tgdbkcrbm8vkafffkm3v0jr602e4e522bpqt4oac0ebb0pk6/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 2023-10-29 23:55:19,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__umam9pphnlfk9eonep15iefrfe3si43fsulvtttiilp0u66gc6c5ce453l207c3p/family1/02fcf9a39216468f82b3aba0beb43946 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_ 2023-10-29 23:55:19,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__n8lq3qeujdb673v9tgdbkcrbm8vkafffkm3v0jr602e4e522bpqt4oac0ebb0pk6/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/a543b205faa54918a03bd03115ddcee7_SeqId_35_ 2023-10-29 23:55:19,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__umam9pphnlfk9eonep15iefrfe3si43fsulvtttiilp0u66gc6c5ce453l207c3p/family1/02fcf9a39216468f82b3aba0beb43946 into dc879cf7ad8f38cb32285196def3085e/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_ - updating store file list. 2023-10-29 23:55:19,089 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__n8lq3qeujdb673v9tgdbkcrbm8vkafffkm3v0jr602e4e522bpqt4oac0ebb0pk6/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 into e64684f25940ad580cd493bca8b0ccb7/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/a543b205faa54918a03bd03115ddcee7_SeqId_35_ - updating store file list. 2023-10-29 23:55:19,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_ into dc879cf7ad8f38cb32285196def3085e/family1 2023-10-29 23:55:19,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__umam9pphnlfk9eonep15iefrfe3si43fsulvtttiilp0u66gc6c5ce453l207c3p/family1/02fcf9a39216468f82b3aba0beb43946 into dc879cf7ad8f38cb32285196def3085e/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_) 2023-10-29 23:55:19,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/a543b205faa54918a03bd03115ddcee7_SeqId_35_ into e64684f25940ad580cd493bca8b0ccb7/family1 2023-10-29 23:55:19,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__n8lq3qeujdb673v9tgdbkcrbm8vkafffkm3v0jr602e4e522bpqt4oac0ebb0pk6/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 into e64684f25940ad580cd493bca8b0ccb7/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/a543b205faa54918a03bd03115ddcee7_SeqId_35_) 2023-10-29 23:55:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__umam9pphnlfk9eonep15iefrfe3si43fsulvtttiilp0u66gc6c5ce453l207c3p/family1/02fcf9a39216468f82b3aba0beb43946 2023-10-29 23:55:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__n8lq3qeujdb673v9tgdbkcrbm8vkafffkm3v0jr602e4e522bpqt4oac0ebb0pk6/family1/1e9ae93eeafc4b5ea9ddfbe1fb5604f4 2023-10-29 23:55:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:19,094 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:19,094 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:19,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-29 23:55:19,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): dc879cf7ad8f38cb32285196def3085e/family1 is initiating minor compaction (all files) 2023-10-29 23:55:19,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7defbfd9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-29 23:55:19,096 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310291f66b9b44bca4e0186bde55583800268 2023-10-29 23:55:19,096 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:19,096 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:19,097 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029285e5cf98d8f494d93be81d5825a391b 2023-10-29 23:55:19,098 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310298d02ff99242a44aa9752d9bb80d72eac 2023-10-29 23:55:19,098 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023102945dbc72554d34589badd21d8999acfd5 2023-10-29 23:55:19,099 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310299b22f105fc86401caf0b1aae173ec2a4 2023-10-29 23:55:19,099 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 23:55:19,099 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 23:55:19,099 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310296539322f7ef74c9ea1c6708606230a5f 2023-10-29 23:55:19,099 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:19,100 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310297b5ec4465bc64e9b8698c3510ca90fbd 2023-10-29 23:55:19,101 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029d30be19caf9647b4a8c4e5bf07102303 2023-10-29 23:55:19,101 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 23:55:19,101 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 23:55:19,101 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:19,428 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029c1d2ecbd2ccd4e43853f1a0ec7af2d62 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029c1d2ecbd2ccd4e43853f1a0ec7af2d62 2023-10-29 23:55:19,429 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:19,452 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2cf9626023b942e896f01388591cab92 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-10-29 23:55:19,452 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2cf9626023b942e896f01388591cab92}] 2023-10-29 23:55:19,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2cf9626023b942e896f01388591cab92 for inclusion in f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:55:19,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-10-29 23:55:19,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 23:55:19,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:19,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2cf9626023b942e896f01388591cab92 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__ilpu33g6q0a8ho15lklcutn23bbbl5r80tff25knlkgm2qklb92ebseg7l3o6ij1/family1/2cf9626023b942e896f01388591cab92 2023-10-29 23:55:19,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__ilpu33g6q0a8ho15lklcutn23bbbl5r80tff25knlkgm2qklb92ebseg7l3o6ij1/family1/2cf9626023b942e896f01388591cab92 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/3c5c46baa92348998e17c37864e0cc9d_SeqId_34_ 2023-10-29 23:55:19,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__ilpu33g6q0a8ho15lklcutn23bbbl5r80tff25knlkgm2qklb92ebseg7l3o6ij1/family1/2cf9626023b942e896f01388591cab92 into f4685077c709633cc85813f6672ca901/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/3c5c46baa92348998e17c37864e0cc9d_SeqId_34_ - updating store file list. 2023-10-29 23:55:19,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/3c5c46baa92348998e17c37864e0cc9d_SeqId_34_ into f4685077c709633cc85813f6672ca901/family1 2023-10-29 23:55:19,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__ilpu33g6q0a8ho15lklcutn23bbbl5r80tff25knlkgm2qklb92ebseg7l3o6ij1/family1/2cf9626023b942e896f01388591cab92 into f4685077c709633cc85813f6672ca901/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/3c5c46baa92348998e17c37864e0cc9d_SeqId_34_) 2023-10-29 23:55:19,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testCompactionWithHFileLink__ilpu33g6q0a8ho15lklcutn23bbbl5r80tff25knlkgm2qklb92ebseg7l3o6ij1/family1/2cf9626023b942e896f01388591cab92 2023-10-29 23:55:19,464 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:19,465 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:19,466 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102900fe504e98e940808c48befd7cb12b21 2023-10-29 23:55:19,467 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102956b20f4fa03b427d8171ccc38705bdb0 2023-10-29 23:55:19,468 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029a0cf20db86af47f581f616f0376e4e8c 2023-10-29 23:55:19,469 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029e46d41f0531f4d3cb4d0d3c42eab5020 2023-10-29 23:55:19,469 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 23:55:19,469 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 23:55:19,470 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 23:55:19,470 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 23:55:19,472 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:19,474 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:19,477 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:19,478 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:19,488 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:19,489 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:19,507 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 247) - Thread LEAK? -, OpenFileDescriptor=755 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=183 (was 124) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=14067 (was 14204) 2023-10-29 23:55:19,520 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=755, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=167, AvailableMemoryMB=14066 2023-10-29 23:55:19,522 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/.tmp/family1/7c60e1d04e124f22a94295d8a6d8f22b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/7c60e1d04e124f22a94295d8a6d8f22b 2023-10-29 23:55:19,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-10-29 23:55:19,527 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e64684f25940ad580cd493bca8b0ccb7/family1 of e64684f25940ad580cd493bca8b0ccb7 into 7c60e1d04e124f22a94295d8a6d8f22b(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:19,527 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:55:19,527 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7., storeName=e64684f25940ad580cd493bca8b0ccb7/family1, priority=12, startTime=1698623718239; duration=1sec 2023-10-29 23:55:19,527 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-29 23:55:19,528 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dc879cf7ad8f38cb32285196def3085e/family1 in testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:19,528 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a11b27a0bb6a47b8a108a21ced420c63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-2655c4ad3e4a436f92c6daa8884d7527, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a7c81bb5b3ab433f8a5a0d001b05603c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-3cdf25c230f542dc824156892aad218b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp, totalSize=28.9 K 2023-10-29 23:55:19,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-10-29 23:55:19,529 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a11b27a0bb6a47b8a108a21ced420c63, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695799 2023-10-29 23:55:19,529 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-2655c4ad3e4a436f92c6daa8884d7527, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:19,530 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a7c81bb5b3ab433f8a5a0d001b05603c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699383 2023-10-29 23:55:19,531 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-3cdf25c230f542dc824156892aad218b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:19,531 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 5014058ad4d342d5bd4da8d7451d3465_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698623695799 2023-10-29 23:55:19,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-29 23:55:19,534 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 23:55:19,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-10-29 23:55:19,546 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): dc879cf7ad8f38cb32285196def3085e#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:19,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-6a094639617b4da692775e72b4ac1d56, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-218cf0b723d14ff49367d56be3e7be63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-dfa4839734fc47d3a1f5a326a9f67ece, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-2ef6f913db2d4d93997af18ab767ca6f] to archive 2023-10-29 23:55:19,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:19,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-6a094639617b4da692775e72b4ac1d56 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-6a094639617b4da692775e72b4ac1d56 2023-10-29 23:55:19,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-218cf0b723d14ff49367d56be3e7be63 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-218cf0b723d14ff49367d56be3e7be63 2023-10-29 23:55:19,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-dfa4839734fc47d3a1f5a326a9f67ece to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-dfa4839734fc47d3a1f5a326a9f67ece 2023-10-29 23:55:19,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-2ef6f913db2d4d93997af18ab767ca6f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/family1/testCompactionWithHFileLink=e64684f25940ad580cd493bca8b0ccb7-2ef6f913db2d4d93997af18ab767ca6f 2023-10-29 23:55:19,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-29 23:55:19,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 23:55:19,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-10-29 23:55:19,637 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:55:19,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-10-29 23:55:19,638 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:55:19,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 23:55:19,639 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:19,639 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7 2023-10-29 23:55:19,639 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e 2023-10-29 23:55:19,640 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc empty. 2023-10-29 23:55:19,640 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e empty. 2023-10-29 23:55:19,640 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7 empty. 2023-10-29 23:55:19,640 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:19,640 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e 2023-10-29 23:55:19,640 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7 2023-10-29 23:55:19,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-10-29 23:55:19,644 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family1/a3212e31c0ec404aba163292a6761fed as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/a3212e31c0ec404aba163292a6761fed 2023-10-29 23:55:19,648 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f4685077c709633cc85813f6672ca901/family1 of f4685077c709633cc85813f6672ca901 into a3212e31c0ec404aba163292a6761fed(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:19,648 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:19,648 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901., storeName=f4685077c709633cc85813f6672ca901/family1, priority=12, startTime=1698623718338; duration=1sec 2023-10-29 23:55:19,648 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-29 23:55:19,648 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-10-29 23:55:19,648 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 23:55:19,648 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 23:55:19,648 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. because compaction request was cancelled 2023-10-29 23:55:19,649 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 23:55:19,650 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 23:55:19,650 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1912): dc879cf7ad8f38cb32285196def3085e/family2 is initiating minor compaction (all files) 2023-10-29 23:55:19,650 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegion(2259): Starting compaction of dc879cf7ad8f38cb32285196def3085e/family2 in testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:55:19,650 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-714febe945864f84ad7ec8c51ebc770a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-37a7c8481f714189932cc8f93bd12632, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-5cb3c2e412bd4a8b84a4d2e3cd136d0e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-c983ae66781e457181f10a4c988b1033] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp, totalSize=20.4 K 2023-10-29 23:55:19,651 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-714febe945864f84ad7ec8c51ebc770a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695799 2023-10-29 23:55:19,651 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-37a7c8481f714189932cc8f93bd12632, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:19,652 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-5cb3c2e412bd4a8b84a4d2e3cd136d0e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699383 2023-10-29 23:55:19,653 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-c983ae66781e457181f10a4c988b1033, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:19,665 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] throttle.PressureAwareThroughputController(145): dc879cf7ad8f38cb32285196def3085e#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:19,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-75b0e82e07c345d0aebf3ac3bee9f997, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-829873d2eebf4b5f984fac02d207f42b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-8632d275427e465dad17149751af6be7, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-078d3d83e36a4d5ebb9f5cabc4aa52c2] to archive 2023-10-29 23:55:19,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:19,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-75b0e82e07c345d0aebf3ac3bee9f997 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-75b0e82e07c345d0aebf3ac3bee9f997 2023-10-29 23:55:19,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-829873d2eebf4b5f984fac02d207f42b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-829873d2eebf4b5f984fac02d207f42b 2023-10-29 23:55:19,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-8632d275427e465dad17149751af6be7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-8632d275427e465dad17149751af6be7 2023-10-29 23:55:19,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-078d3d83e36a4d5ebb9f5cabc4aa52c2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family1/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-078d3d83e36a4d5ebb9f5cabc4aa52c2 2023-10-29 23:55:19,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 23:55:19,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 23:55:20,047 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-10-29 23:55:20,048 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 8062191887307ceea838f50b05ff311e, NAME => 'ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:55:20,048 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 27ca3771a04def85215201203d9952c7, NAME => 'ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:55:20,048 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9503a9edc2e7fdcd40523a76a7ac98fc, NAME => 'ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:55:20,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 23:55:20,367 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family1/aa56c99fc3ca4f4c976fa83ff55c0cfc as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/aa56c99fc3ca4f4c976fa83ff55c0cfc 2023-10-29 23:55:20,371 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in dc879cf7ad8f38cb32285196def3085e/family1 of dc879cf7ad8f38cb32285196def3085e into aa56c99fc3ca4f4c976fa83ff55c0cfc(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:20,371 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:20,371 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698623719094; duration=0sec 2023-10-29 23:55:20,371 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 23:55:20,371 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 23:55:20,373 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 23:55:20,374 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1912): f4685077c709633cc85813f6672ca901/family2 is initiating minor compaction (all files) 2023-10-29 23:55:20,374 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f4685077c709633cc85813f6672ca901/family2 in testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:55:20,374 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9de024002acd4492bd34872e8c74ef2b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9d51fae5a73d4c919eebe6a25c8d94a5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-1472ed6ac3ea4e819d399c51690dcc41, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-0bdb82b92ee64389904f8a330571af37] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp, totalSize=20.4 K 2023-10-29 23:55:20,374 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9de024002acd4492bd34872e8c74ef2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623695800 2023-10-29 23:55:20,375 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9d51fae5a73d4c919eebe6a25c8d94a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623697583 2023-10-29 23:55:20,376 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-1472ed6ac3ea4e819d399c51690dcc41, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623699384 2023-10-29 23:55:20,376 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-0bdb82b92ee64389904f8a330571af37, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623701166 2023-10-29 23:55:20,387 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): f4685077c709633cc85813f6672ca901#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:20,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a11b27a0bb6a47b8a108a21ced420c63, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-2655c4ad3e4a436f92c6daa8884d7527, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a7c81bb5b3ab433f8a5a0d001b05603c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-3cdf25c230f542dc824156892aad218b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_] to archive 2023-10-29 23:55:20,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:20,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a11b27a0bb6a47b8a108a21ced420c63 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a11b27a0bb6a47b8a108a21ced420c63 2023-10-29 23:55:20,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-2655c4ad3e4a436f92c6daa8884d7527 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-2655c4ad3e4a436f92c6daa8884d7527 2023-10-29 23:55:20,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a7c81bb5b3ab433f8a5a0d001b05603c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-a7c81bb5b3ab433f8a5a0d001b05603c 2023-10-29 23:55:20,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-3cdf25c230f542dc824156892aad218b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-3cdf25c230f542dc824156892aad218b 2023-10-29 23:55:20,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family1/5014058ad4d342d5bd4da8d7451d3465_SeqId_34_ 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 9503a9edc2e7fdcd40523a76a7ac98fc, disabling compactions & flushes 2023-10-29 23:55:20,454 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 8062191887307ceea838f50b05ff311e, disabling compactions & flushes 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. after waiting 0 ms 2023-10-29 23:55:20,454 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 27ca3771a04def85215201203d9952c7, disabling compactions & flushes 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. after waiting 0 ms 2023-10-29 23:55:20,454 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:20,454 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:20,454 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:20,454 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. after waiting 0 ms 2023-10-29 23:55:20,455 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:20,455 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:20,455 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:20,457 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:55:20,458 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698623720458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623720458"}]},"ts":"1698623720458"} 2023-10-29 23:55:20,458 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698623720458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623720458"}]},"ts":"1698623720458"} 2023-10-29 23:55:20,458 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698623720458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623720458"}]},"ts":"1698623720458"} 2023-10-29 23:55:20,460 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 23:55:20,460 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:55:20,460 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623720460"}]},"ts":"1698623720460"} 2023-10-29 23:55:20,461 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-10-29 23:55:20,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9503a9edc2e7fdcd40523a76a7ac98fc, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ca3771a04def85215201203d9952c7, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8062191887307ceea838f50b05ff311e, ASSIGN}] 2023-10-29 23:55:20,467 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8062191887307ceea838f50b05ff311e, ASSIGN 2023-10-29 23:55:20,467 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ca3771a04def85215201203d9952c7, ASSIGN 2023-10-29 23:55:20,467 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9503a9edc2e7fdcd40523a76a7ac98fc, ASSIGN 2023-10-29 23:55:20,468 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8062191887307ceea838f50b05ff311e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:55:20,468 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9503a9edc2e7fdcd40523a76a7ac98fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:55:20,468 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ca3771a04def85215201203d9952c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:55:20,469 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:55:20,483 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/.tmp/family2/421d810feb8b4677ab960ab9ad1b0adc as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/421d810feb8b4677ab960ab9ad1b0adc 2023-10-29 23:55:20,487 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in dc879cf7ad8f38cb32285196def3085e/family2 of dc879cf7ad8f38cb32285196def3085e into 421d810feb8b4677ab960ab9ad1b0adc(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:20,487 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:55:20,487 INFO [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e., storeName=dc879cf7ad8f38cb32285196def3085e/family2, priority=12, startTime=1698623718448; duration=0sec 2023-10-29 23:55:20,488 DEBUG [RS:0;jenkins-hbase4:40533-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:20,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-714febe945864f84ad7ec8c51ebc770a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-37a7c8481f714189932cc8f93bd12632, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-5cb3c2e412bd4a8b84a4d2e3cd136d0e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-c983ae66781e457181f10a4c988b1033] to archive 2023-10-29 23:55:20,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:20,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-714febe945864f84ad7ec8c51ebc770a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-714febe945864f84ad7ec8c51ebc770a 2023-10-29 23:55:20,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-37a7c8481f714189932cc8f93bd12632 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-37a7c8481f714189932cc8f93bd12632 2023-10-29 23:55:20,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-5cb3c2e412bd4a8b84a4d2e3cd136d0e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-5cb3c2e412bd4a8b84a4d2e3cd136d0e 2023-10-29 23:55:20,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-c983ae66781e457181f10a4c988b1033 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/family2/testCompactionWithHFileLink=dc879cf7ad8f38cb32285196def3085e-c983ae66781e457181f10a4c988b1033 2023-10-29 23:55:20,621 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=27ca3771a04def85215201203d9952c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:20,621 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=8062191887307ceea838f50b05ff311e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:20,621 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9503a9edc2e7fdcd40523a76a7ac98fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:20,621 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698623720621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623720621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623720621"}]},"ts":"1698623720621"} 2023-10-29 23:55:20,621 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698623720621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623720621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623720621"}]},"ts":"1698623720621"} 2023-10-29 23:55:20,621 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698623720621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623720621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623720621"}]},"ts":"1698623720621"} 2023-10-29 23:55:20,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 27ca3771a04def85215201203d9952c7, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:20,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 9503a9edc2e7fdcd40523a76a7ac98fc, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:20,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 8062191887307ceea838f50b05ff311e, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:20,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 23:55:20,774 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:20,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:20,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9503a9edc2e7fdcd40523a76a7ac98fc, NAME => 'ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 23:55:20,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:20,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,778 INFO [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,779 DEBUG [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1 2023-10-29 23:55:20,779 DEBUG [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1 2023-10-29 23:55:20,780 INFO [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9503a9edc2e7fdcd40523a76a7ac98fc columnFamilyName family1 2023-10-29 23:55:20,781 INFO [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] regionserver.HStore(310): Store=9503a9edc2e7fdcd40523a76a7ac98fc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:20,781 INFO [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,782 DEBUG [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2 2023-10-29 23:55:20,782 DEBUG [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2 2023-10-29 23:55:20,782 INFO [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9503a9edc2e7fdcd40523a76a7ac98fc columnFamilyName family2 2023-10-29 23:55:20,783 INFO [StoreOpener-9503a9edc2e7fdcd40523a76a7ac98fc-1] regionserver.HStore(310): Store=9503a9edc2e7fdcd40523a76a7ac98fc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:20,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:20,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:55:20,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:55:20,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9503a9edc2e7fdcd40523a76a7ac98fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69629167, jitterRate=0.03755544126033783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:20,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:20,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc., pid=110, masterSystemTime=1698623720774 2023-10-29 23:55:20,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:20,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:20,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:20,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8062191887307ceea838f50b05ff311e, NAME => 'ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 23:55:20,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9503a9edc2e7fdcd40523a76a7ac98fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:20,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:20,790 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698623720789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623720789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623720789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623720789"}]},"ts":"1698623720789"} 2023-10-29 23:55:20,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,791 INFO [StoreOpener-8062191887307ceea838f50b05ff311e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,792 DEBUG [StoreOpener-8062191887307ceea838f50b05ff311e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1 2023-10-29 23:55:20,792 DEBUG [StoreOpener-8062191887307ceea838f50b05ff311e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1 2023-10-29 23:55:20,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=106 2023-10-29 23:55:20,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 9503a9edc2e7fdcd40523a76a7ac98fc, server=jenkins-hbase4.apache.org,40533,1698623599827 in 168 msec 2023-10-29 23:55:20,792 INFO [StoreOpener-8062191887307ceea838f50b05ff311e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8062191887307ceea838f50b05ff311e columnFamilyName family1 2023-10-29 23:55:20,793 INFO [StoreOpener-8062191887307ceea838f50b05ff311e-1] regionserver.HStore(310): Store=8062191887307ceea838f50b05ff311e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:20,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9503a9edc2e7fdcd40523a76a7ac98fc, ASSIGN in 327 msec 2023-10-29 23:55:20,793 INFO [StoreOpener-8062191887307ceea838f50b05ff311e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,794 DEBUG [StoreOpener-8062191887307ceea838f50b05ff311e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2 2023-10-29 23:55:20,794 DEBUG [StoreOpener-8062191887307ceea838f50b05ff311e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2 2023-10-29 23:55:20,794 INFO [StoreOpener-8062191887307ceea838f50b05ff311e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8062191887307ceea838f50b05ff311e columnFamilyName family2 2023-10-29 23:55:20,795 INFO [StoreOpener-8062191887307ceea838f50b05ff311e-1] regionserver.HStore(310): Store=8062191887307ceea838f50b05ff311e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:20,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:20,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8062191887307ceea838f50b05ff311e 2023-10-29 23:55:20,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:55:20,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8062191887307ceea838f50b05ff311e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59155794, jitterRate=-0.11850997805595398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:20,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:20,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e., pid=111, masterSystemTime=1698623720774 2023-10-29 23:55:20,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:20,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:20,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:20,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27ca3771a04def85215201203d9952c7, NAME => 'ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 23:55:20,801 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=8062191887307ceea838f50b05ff311e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:20,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:20,802 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698623720801"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623720801"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623720801"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623720801"}]},"ts":"1698623720801"} 2023-10-29 23:55:20,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,803 INFO [StoreOpener-27ca3771a04def85215201203d9952c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,804 DEBUG [StoreOpener-27ca3771a04def85215201203d9952c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1 2023-10-29 23:55:20,804 DEBUG [StoreOpener-27ca3771a04def85215201203d9952c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1 2023-10-29 23:55:20,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-10-29 23:55:20,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 8062191887307ceea838f50b05ff311e, server=jenkins-hbase4.apache.org,40533,1698623599827 in 180 msec 2023-10-29 23:55:20,804 INFO [StoreOpener-27ca3771a04def85215201203d9952c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27ca3771a04def85215201203d9952c7 columnFamilyName family1 2023-10-29 23:55:20,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8062191887307ceea838f50b05ff311e, ASSIGN in 339 msec 2023-10-29 23:55:20,805 INFO [StoreOpener-27ca3771a04def85215201203d9952c7-1] regionserver.HStore(310): Store=27ca3771a04def85215201203d9952c7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:20,805 INFO [StoreOpener-27ca3771a04def85215201203d9952c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,806 DEBUG [StoreOpener-27ca3771a04def85215201203d9952c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2 2023-10-29 23:55:20,806 DEBUG [StoreOpener-27ca3771a04def85215201203d9952c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2 2023-10-29 23:55:20,806 INFO [StoreOpener-27ca3771a04def85215201203d9952c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27ca3771a04def85215201203d9952c7 columnFamilyName family2 2023-10-29 23:55:20,807 INFO [StoreOpener-27ca3771a04def85215201203d9952c7-1] regionserver.HStore(310): Store=27ca3771a04def85215201203d9952c7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:20,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:20,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27ca3771a04def85215201203d9952c7 2023-10-29 23:55:20,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:55:20,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27ca3771a04def85215201203d9952c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66103517, jitterRate=-0.01498083770275116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:20,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:20,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7., pid=109, masterSystemTime=1698623720774 2023-10-29 23:55:20,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:20,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:20,813 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=27ca3771a04def85215201203d9952c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:20,813 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698623720813"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623720813"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623720813"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623720813"}]},"ts":"1698623720813"} 2023-10-29 23:55:20,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-29 23:55:20,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 27ca3771a04def85215201203d9952c7, server=jenkins-hbase4.apache.org,40533,1698623599827 in 192 msec 2023-10-29 23:55:20,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-29 23:55:20,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ca3771a04def85215201203d9952c7, ASSIGN in 350 msec 2023-10-29 23:55:20,817 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:55:20,817 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623720817"}]},"ts":"1698623720817"} 2023-10-29 23:55:20,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-10-29 23:55:20,819 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:55:20,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1840 sec 2023-10-29 23:55:21,603 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/.tmp/family2/974766f2f4994e16b783fa5ed68c61a2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/974766f2f4994e16b783fa5ed68c61a2 2023-10-29 23:55:21,607 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f4685077c709633cc85813f6672ca901/family2 of f4685077c709633cc85813f6672ca901 into 974766f2f4994e16b783fa5ed68c61a2(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:21,607 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:55:21,607 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901., storeName=f4685077c709633cc85813f6672ca901/family2, priority=12, startTime=1698623718338; duration=1sec 2023-10-29 23:55:21,608 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:21,678 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-29 23:55:21,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9de024002acd4492bd34872e8c74ef2b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9d51fae5a73d4c919eebe6a25c8d94a5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-1472ed6ac3ea4e819d399c51690dcc41, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-0bdb82b92ee64389904f8a330571af37] to archive 2023-10-29 23:55:21,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:21,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9de024002acd4492bd34872e8c74ef2b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9de024002acd4492bd34872e8c74ef2b 2023-10-29 23:55:21,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9d51fae5a73d4c919eebe6a25c8d94a5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-9d51fae5a73d4c919eebe6a25c8d94a5 2023-10-29 23:55:21,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-1472ed6ac3ea4e819d399c51690dcc41 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-1472ed6ac3ea4e819d399c51690dcc41 2023-10-29 23:55:21,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-0bdb82b92ee64389904f8a330571af37 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/family2/testCompactionWithHFileLink=f4685077c709633cc85813f6672ca901-0bdb82b92ee64389904f8a330571af37 2023-10-29 23:55:21,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 23:55:21,743 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-10-29 23:55:21,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:21,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:21,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:21,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:21,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 23:55:21,751 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 23:55:21,751 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:21,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 23:55:21,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 23:55:21,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:21,752 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:21,753 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:21,753 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:21,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:21,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:21,754 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:21,754 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:21,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:21,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:21,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:21,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:21,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 23:55:21,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 23:55:21,754 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 23:55:21,754 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:21,754 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 23:55:21,755 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:21,755 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:21,755 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:21,755 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:21,755 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:21,755 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. started... 2023-10-29 23:55:21,755 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. started... 2023-10-29 23:55:21,755 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. started... 2023-10-29 23:55:21,757 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9503a9edc2e7fdcd40523a76a7ac98fc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:55:21,757 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8062191887307ceea838f50b05ff311e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:55:21,757 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 27ca3771a04def85215201203d9952c7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:55:22,169 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310299e5c3d16d00943b2a54b04dd36382334 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310299e5c3d16d00943b2a54b04dd36382334 2023-10-29 23:55:22,169 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029feb6ab6521954fc0a2417c57af9cb644 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029feb6ab6521954fc0a2417c57af9cb644 2023-10-29 23:55:22,169 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029854914a048bd44629b7bb1b97ffa8402 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029854914a048bd44629b7bb1b97ffa8402 2023-10-29 23:55:22,174 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/2d358180af584b69bb19e2f3475b28af 2023-10-29 23:55:22,174 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/e0ce81cd1c33412cabd4b1b2572cff00 2023-10-29 23:55:22,574 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/2bb15235ff3a49659f8e6f86eb22392c 2023-10-29 23:55:22,587 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029d68845332e004790b68ab37f8e294b9f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231029d68845332e004790b68ab37f8e294b9f 2023-10-29 23:55:22,587 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029e5a9cef1498149a083de4129ef25022e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231029e5a9cef1498149a083de4129ef25022e 2023-10-29 23:55:22,595 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/bc6c11abb4774d4ea2ecfb726bd96cc0 2023-10-29 23:55:22,599 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/2d358180af584b69bb19e2f3475b28af as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/2d358180af584b69bb19e2f3475b28af 2023-10-29 23:55:22,602 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/2d358180af584b69bb19e2f3475b28af, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 23:55:22,603 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/bc6c11abb4774d4ea2ecfb726bd96cc0 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/bc6c11abb4774d4ea2ecfb726bd96cc0 2023-10-29 23:55:22,606 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/bc6c11abb4774d4ea2ecfb726bd96cc0, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:55:22,606 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8062191887307ceea838f50b05ff311e in 849ms, sequenceid=5, compaction requested=false 2023-10-29 23:55:22,607 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:22,607 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:22,607 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:22,988 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310299b4debe953b941108a100d5497f834df to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310299b4debe953b941108a100d5497f834df 2023-10-29 23:55:22,995 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/70deb18a4f39417a9ba444451d0fba96 2023-10-29 23:55:22,999 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/e0ce81cd1c33412cabd4b1b2572cff00 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/e0ce81cd1c33412cabd4b1b2572cff00 2023-10-29 23:55:23,002 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/e0ce81cd1c33412cabd4b1b2572cff00, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 23:55:23,003 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/70deb18a4f39417a9ba444451d0fba96 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/70deb18a4f39417a9ba444451d0fba96 2023-10-29 23:55:23,005 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/70deb18a4f39417a9ba444451d0fba96, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:55:23,006 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 27ca3771a04def85215201203d9952c7 in 1249ms, sequenceid=5, compaction requested=false 2023-10-29 23:55:23,006 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:23,006 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:23,006 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:23,393 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/6e457d656e8149f4afcaeca4314a5ba6 2023-10-29 23:55:23,398 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/2bb15235ff3a49659f8e6f86eb22392c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/2bb15235ff3a49659f8e6f86eb22392c 2023-10-29 23:55:23,401 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/2bb15235ff3a49659f8e6f86eb22392c, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 23:55:23,402 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/6e457d656e8149f4afcaeca4314a5ba6 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/6e457d656e8149f4afcaeca4314a5ba6 2023-10-29 23:55:23,406 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/6e457d656e8149f4afcaeca4314a5ba6, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:55:23,407 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9503a9edc2e7fdcd40523a76a7ac98fc in 1650ms, sequenceid=5, compaction requested=false 2023-10-29 23:55:23,407 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:23,407 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 23:55:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 23:55:23,410 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,410 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:23,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:23,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:23,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:23,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 23:55:23,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56bdfd5d[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:23,412 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 23:55:23,412 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,414 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 23:55:23,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 23:55:23,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:23,414 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,414 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:23,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 23:55:23,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:23,415 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,415 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 23:55:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:23,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 23:55:23,418 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 23:55:23,418 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:23,419 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:23,419 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 23:55:23,419 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:23,420 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,420 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:23,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,420 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:23,423 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:23,424 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,427 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,427 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:23,427 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:23,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:23,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 23:55:23,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:23,427 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:23,427 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:23,428 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,427 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:23,428 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:23,428 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:23,428 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:23,428 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:23,428 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:23,528 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:23,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:23,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:23,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:23,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:23,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:23,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:23,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 23:55:23,535 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 23:55:23,535 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:23,535 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 23:55:23,535 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 23:55:23,535 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,535 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:23,536 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:23,536 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:23,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:23,537 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:23,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:23,537 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:23,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:23,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:23,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:23,538 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 23:55:23,538 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 23:55:23,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 23:55:23,538 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 23:55:23,538 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:23,538 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 23:55:23,541 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:23,541 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. started... 2023-10-29 23:55:23,541 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8062191887307ceea838f50b05ff311e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:55:23,545 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:23,545 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. started... 2023-10-29 23:55:23,545 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9503a9edc2e7fdcd40523a76a7ac98fc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:55:23,545 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:23,545 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:23,545 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:23,545 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. started... 2023-10-29 23:55:23,545 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 27ca3771a04def85215201203d9952c7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:55:23,581 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310297d042a1fd0c94cbf9061c4529cd2e3da to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310297d042a1fd0c94cbf9061c4529cd2e3da 2023-10-29 23:55:23,616 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/b006e9e881674ea6bee91c49a80109d9 2023-10-29 23:55:23,630 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310293a1ecbabef604f06874fb09ee483f010 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310293a1ecbabef604f06874fb09ee483f010 2023-10-29 23:55:23,643 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/8eefc9f00f1c482182f40cf60eacbb4e 2023-10-29 23:55:23,653 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/b006e9e881674ea6bee91c49a80109d9 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/b006e9e881674ea6bee91c49a80109d9 2023-10-29 23:55:23,657 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/b006e9e881674ea6bee91c49a80109d9, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 23:55:23,658 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/8eefc9f00f1c482182f40cf60eacbb4e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/8eefc9f00f1c482182f40cf60eacbb4e 2023-10-29 23:55:23,662 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/8eefc9f00f1c482182f40cf60eacbb4e, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:55:23,663 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 27ca3771a04def85215201203d9952c7 in 118ms, sequenceid=9, compaction requested=false 2023-10-29 23:55:23,663 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:23,663 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:23,663 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:23,974 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102992952170be0d4493911d8ebc41db1476 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023102992952170be0d4493911d8ebc41db1476 2023-10-29 23:55:23,979 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/1a7aa0867f7d41fc9f19d7facc8872d5 2023-10-29 23:55:23,980 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029cd1126557be947cb818fd6806f0f3cc1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029cd1126557be947cb818fd6806f0f3cc1 2023-10-29 23:55:23,985 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/317f9a21949b482f84b9000d808975b6 2023-10-29 23:55:24,002 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102932e7298e264542d5bb28cc5d28e7f8d1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023102932e7298e264542d5bb28cc5d28e7f8d1 2023-10-29 23:55:24,396 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029921f70a2a56f454583650a3b37b5c616 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231029921f70a2a56f454583650a3b37b5c616 2023-10-29 23:55:24,409 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/dbb85193bd074e19a1fb8526335b45ee 2023-10-29 23:55:24,413 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/317f9a21949b482f84b9000d808975b6 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/317f9a21949b482f84b9000d808975b6 2023-10-29 23:55:24,416 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/317f9a21949b482f84b9000d808975b6, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 23:55:24,416 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/dbb85193bd074e19a1fb8526335b45ee as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/dbb85193bd074e19a1fb8526335b45ee 2023-10-29 23:55:24,419 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/dbb85193bd074e19a1fb8526335b45ee, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:55:24,420 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9503a9edc2e7fdcd40523a76a7ac98fc in 875ms, sequenceid=9, compaction requested=false 2023-10-29 23:55:24,420 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:24,420 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:24,420 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:24,802 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/30c0137f79ca4570b7b8ad76bf01fd98 2023-10-29 23:55:24,805 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/1a7aa0867f7d41fc9f19d7facc8872d5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/1a7aa0867f7d41fc9f19d7facc8872d5 2023-10-29 23:55:24,809 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/1a7aa0867f7d41fc9f19d7facc8872d5, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 23:55:24,810 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/30c0137f79ca4570b7b8ad76bf01fd98 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/30c0137f79ca4570b7b8ad76bf01fd98 2023-10-29 23:55:24,812 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/30c0137f79ca4570b7b8ad76bf01fd98, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:55:24,813 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8062191887307ceea838f50b05ff311e in 1272ms, sequenceid=9, compaction requested=false 2023-10-29 23:55:24,813 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:24,813 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:24,813 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:24,813 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:24,813 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,813 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 23:55:24,813 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 23:55:24,815 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,815 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:24,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:24,815 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,815 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:24,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:24,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 23:55:24,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60b6ec58[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:24,817 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 23:55:24,817 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,818 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,818 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 23:55:24,818 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 23:55:24,818 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:24,818 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,818 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:24,823 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 23:55:24,823 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,823 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,823 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 23:55:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:24,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:24,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:24,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 23:55:24,825 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 23:55:24,825 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:24,825 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:24,825 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 23:55:24,825 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:24,826 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,826 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:24,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:24,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,826 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:24,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:24,827 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,828 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:24,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:24,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 23:55:24,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:24,830 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:24,830 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:24,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:24,831 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:24,831 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:24,931 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:24,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:24,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:24,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:24,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:24,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:24,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:24,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 23:55:24,937 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 23:55:24,937 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:24,937 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 23:55:24,937 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 23:55:24,938 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,938 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:24,939 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,939 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:24,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:24,939 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:24,939 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:24,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:24,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 23:55:24,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 23:55:24,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 23:55:24,940 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 23:55:24,940 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:24,940 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 23:55:24,941 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:24,941 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. started... 2023-10-29 23:55:24,941 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:24,941 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. started... 2023-10-29 23:55:24,941 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:24,941 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8062191887307ceea838f50b05ff311e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:55:24,941 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9503a9edc2e7fdcd40523a76a7ac98fc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:55:24,941 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:24,941 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. started... 2023-10-29 23:55:24,941 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 27ca3771a04def85215201203d9952c7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:55:24,941 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:24,958 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029996e5b5d168c4140aa04093f3f3f2e6c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029996e5b5d168c4140aa04093f3f3f2e6c 2023-10-29 23:55:24,965 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/d953b9c4044c4526ade69be19785946c 2023-10-29 23:55:25,354 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029223cdf5cecc6427a8c150dcb67177d1a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029223cdf5cecc6427a8c150dcb67177d1a 2023-10-29 23:55:25,361 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310294666efac56134595a0caeef751633e0c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310294666efac56134595a0caeef751633e0c 2023-10-29 23:55:25,367 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/275e48d4190f43989a82519bae3bf07f 2023-10-29 23:55:25,399 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029ffb4795e48c34b9f998e28647cd69dd1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231029ffb4795e48c34b9f998e28647cd69dd1 2023-10-29 23:55:25,407 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310298ed95e77f67746ceb7cc9a1fdaec3bb4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310298ed95e77f67746ceb7cc9a1fdaec3bb4 2023-10-29 23:55:25,423 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/240665802b794836aaffafce18bf9a01 2023-10-29 23:55:25,426 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/c15fa6fae1314c9baa27b7f157e3fe58 2023-10-29 23:55:25,431 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/d953b9c4044c4526ade69be19785946c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/d953b9c4044c4526ade69be19785946c 2023-10-29 23:55:25,431 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/275e48d4190f43989a82519bae3bf07f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/275e48d4190f43989a82519bae3bf07f 2023-10-29 23:55:25,436 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/d953b9c4044c4526ade69be19785946c, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 23:55:25,437 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/275e48d4190f43989a82519bae3bf07f, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 23:55:25,438 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/240665802b794836aaffafce18bf9a01 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/240665802b794836aaffafce18bf9a01 2023-10-29 23:55:25,438 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/c15fa6fae1314c9baa27b7f157e3fe58 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/c15fa6fae1314c9baa27b7f157e3fe58 2023-10-29 23:55:25,446 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/240665802b794836aaffafce18bf9a01, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:25,447 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9503a9edc2e7fdcd40523a76a7ac98fc in 506ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:25,447 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:25,447 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:25,448 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:25,449 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/c15fa6fae1314c9baa27b7f157e3fe58, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:25,450 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8062191887307ceea838f50b05ff311e in 509ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:25,450 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:25,450 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:25,450 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:25,772 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/c0699854507d46a29f281d4dd8d0da57 2023-10-29 23:55:26,192 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102927eb35bf4f4a46c880a8c28f619f7070 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023102927eb35bf4f4a46c880a8c28f619f7070 2023-10-29 23:55:26,278 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:55:26,596 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/925ba2fb8ef941d59548d6865c4dc6d5 2023-10-29 23:55:26,601 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/c0699854507d46a29f281d4dd8d0da57 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/c0699854507d46a29f281d4dd8d0da57 2023-10-29 23:55:26,604 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/c0699854507d46a29f281d4dd8d0da57, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 23:55:26,605 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/925ba2fb8ef941d59548d6865c4dc6d5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/925ba2fb8ef941d59548d6865c4dc6d5 2023-10-29 23:55:26,608 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/925ba2fb8ef941d59548d6865c4dc6d5, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:26,609 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 27ca3771a04def85215201203d9952c7 in 1668ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:26,609 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:26,609 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:26,609 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:26,609 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:26,609 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,610 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 23:55:26,610 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 23:55:26,612 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:26,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:26,612 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,612 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:26,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:26,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 23:55:26,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aeebae0[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:26,614 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 23:55:26,614 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,615 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 23:55:26,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 23:55:26,615 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:26,615 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,615 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:26,616 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 23:55:26,616 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:26,616 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,616 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 23:55:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:26,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:26,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:26,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:26,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:26,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 23:55:26,618 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 23:55:26,618 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:26,619 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:26,619 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 23:55:26,619 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:26,620 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,620 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:26,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,620 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:26,621 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:26,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:26,622 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:26,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 23:55:26,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:26,629 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:26,629 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:26,630 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:26,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-29 23:55:26,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:26,730 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:26,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:26,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:26,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:26,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:26,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:26,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:26,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 23:55:26,735 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 23:55:26,735 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:26,735 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 23:55:26,735 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 23:55:26,736 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,736 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:26,737 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,737 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:26,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:26,737 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:26,737 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:26,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:26,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 23:55:26,738 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 23:55:26,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 23:55:26,738 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 23:55:26,738 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:26,738 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 23:55:26,738 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:26,738 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. started... 2023-10-29 23:55:26,738 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:26,738 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:26,738 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8062191887307ceea838f50b05ff311e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:26,738 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:26,738 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:26,739 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. started... 2023-10-29 23:55:26,739 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. started... 2023-10-29 23:55:26,739 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9503a9edc2e7fdcd40523a76a7ac98fc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:26,739 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 27ca3771a04def85215201203d9952c7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:27,150 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102918af59e4e6394e9b8e37300e1a440a30 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023102918af59e4e6394e9b8e37300e1a440a30 2023-10-29 23:55:27,154 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310295737cff814714fbaa60b61cecb63149d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310295737cff814714fbaa60b61cecb63149d 2023-10-29 23:55:27,160 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029a8513e2e18fd44878acee35a071f4c1c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029a8513e2e18fd44878acee35a071f4c1c 2023-10-29 23:55:27,567 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/4d41e318a62c49b0a4ac44c4cb3fd41b 2023-10-29 23:55:27,568 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/a46276029e4b4f3d8dc260ee2f60789a 2023-10-29 23:55:27,568 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/29d8ed56db864fba8fe27a2afbcb7626 2023-10-29 23:55:27,984 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029a247d978492145aeb137e53aec87a853 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231029a247d978492145aeb137e53aec87a853 2023-10-29 23:55:27,984 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102980ffb8cb3dbd4227988a3dce50b35f48 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023102980ffb8cb3dbd4227988a3dce50b35f48 2023-10-29 23:55:27,985 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029130bdb17154e40c2a38aaa21308a43ec to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231029130bdb17154e40c2a38aaa21308a43ec 2023-10-29 23:55:27,993 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/93c80871aef64d5d97693ad8edb00758 2023-10-29 23:55:27,994 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/361740550697450b84cb78edfe8016de 2023-10-29 23:55:27,998 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/4d41e318a62c49b0a4ac44c4cb3fd41b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4d41e318a62c49b0a4ac44c4cb3fd41b 2023-10-29 23:55:27,998 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/29d8ed56db864fba8fe27a2afbcb7626 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/29d8ed56db864fba8fe27a2afbcb7626 2023-10-29 23:55:28,001 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4d41e318a62c49b0a4ac44c4cb3fd41b, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 23:55:28,001 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/29d8ed56db864fba8fe27a2afbcb7626, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 23:55:28,002 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/93c80871aef64d5d97693ad8edb00758 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/93c80871aef64d5d97693ad8edb00758 2023-10-29 23:55:28,002 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/361740550697450b84cb78edfe8016de as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/361740550697450b84cb78edfe8016de 2023-10-29 23:55:28,005 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/93c80871aef64d5d97693ad8edb00758, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:28,005 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/361740550697450b84cb78edfe8016de, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:28,006 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8062191887307ceea838f50b05ff311e in 1268ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:28,006 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:28,006 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:28,006 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:28,006 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9503a9edc2e7fdcd40523a76a7ac98fc in 1267ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:28,006 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:28,006 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:28,006 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:28,394 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/a838a402a6cd4a23a3fbdb4f34c9d85e 2023-10-29 23:55:28,399 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/a46276029e4b4f3d8dc260ee2f60789a as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/a46276029e4b4f3d8dc260ee2f60789a 2023-10-29 23:55:28,402 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/a46276029e4b4f3d8dc260ee2f60789a, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 23:55:28,404 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/a838a402a6cd4a23a3fbdb4f34c9d85e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/a838a402a6cd4a23a3fbdb4f34c9d85e 2023-10-29 23:55:28,408 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/a838a402a6cd4a23a3fbdb4f34c9d85e, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:28,409 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 27ca3771a04def85215201203d9952c7 in 1670ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:28,409 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:28,409 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 23:55:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 23:55:28,411 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:28,411 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:28,411 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,411 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:28,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 23:55:28,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7301ced4[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:28,413 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 23:55:28,413 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,414 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 23:55:28,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 23:55:28,414 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:28,414 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,414 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:28,416 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:28,416 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 23:55:28,416 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:28,416 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 23:55:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:28,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:28,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:28,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:28,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 23:55:28,418 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 23:55:28,418 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:28,418 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:28,418 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 23:55:28,418 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:28,420 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:28,420 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,420 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:28,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:28,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:28,421 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:28,422 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:28,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:28,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:28,432 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,432 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:28,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 23:55:28,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:28,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:28,433 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:28,433 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:28,533 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:28,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:28,547 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:28,558 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:28,569 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:28,570 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:28,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:28,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:28,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 23:55:28,621 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 23:55:28,621 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:28,621 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 23:55:28,621 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 23:55:28,622 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,622 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:28,623 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,623 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:28,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:28,624 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:28,624 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:28,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:28,625 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 23:55:28,626 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 23:55:28,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 23:55:28,626 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 23:55:28,626 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:28,626 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 23:55:28,626 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:28,626 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. started... 2023-10-29 23:55:28,627 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8062191887307ceea838f50b05ff311e 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:28,629 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:28,629 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. started... 2023-10-29 23:55:28,629 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9503a9edc2e7fdcd40523a76a7ac98fc 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:28,633 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:28,633 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:28,633 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:28,633 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. started... 2023-10-29 23:55:28,633 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 27ca3771a04def85215201203d9952c7 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:28,682 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/26c0e0f64bec49b6b05f54ab2ff5b58b 2023-10-29 23:55:28,684 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/85590a2873c84cc7af611d52cb5ac04e 2023-10-29 23:55:28,687 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26c0e0f64bec49b6b05f54ab2ff5b58b 2023-10-29 23:55:28,688 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85590a2873c84cc7af611d52cb5ac04e 2023-10-29 23:55:28,710 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/3a18822c463441d38937cb7e920f9d4d 2023-10-29 23:55:28,713 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a18822c463441d38937cb7e920f9d4d 2023-10-29 23:55:28,714 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/85590a2873c84cc7af611d52cb5ac04e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/85590a2873c84cc7af611d52cb5ac04e 2023-10-29 23:55:28,718 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85590a2873c84cc7af611d52cb5ac04e 2023-10-29 23:55:28,719 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/85590a2873c84cc7af611d52cb5ac04e, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:28,719 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/3a18822c463441d38937cb7e920f9d4d as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/3a18822c463441d38937cb7e920f9d4d 2023-10-29 23:55:28,723 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a18822c463441d38937cb7e920f9d4d 2023-10-29 23:55:28,723 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/3a18822c463441d38937cb7e920f9d4d, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:28,724 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9503a9edc2e7fdcd40523a76a7ac98fc in 95ms, sequenceid=23, compaction requested=true 2023-10-29 23:55:28,724 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:28,724 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:28,724 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:29,070 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5 2023-10-29 23:55:29,075 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f14ff72f05f4c0bbb4eebc46cadcbe5 2023-10-29 23:55:29,104 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/4dde8c54dcc84a0783792996159b293f 2023-10-29 23:55:29,108 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4dde8c54dcc84a0783792996159b293f 2023-10-29 23:55:29,109 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/26c0e0f64bec49b6b05f54ab2ff5b58b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/26c0e0f64bec49b6b05f54ab2ff5b58b 2023-10-29 23:55:29,113 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26c0e0f64bec49b6b05f54ab2ff5b58b 2023-10-29 23:55:29,113 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/26c0e0f64bec49b6b05f54ab2ff5b58b, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:29,114 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/4dde8c54dcc84a0783792996159b293f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/4dde8c54dcc84a0783792996159b293f 2023-10-29 23:55:29,117 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4dde8c54dcc84a0783792996159b293f 2023-10-29 23:55:29,117 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/4dde8c54dcc84a0783792996159b293f, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:29,118 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 27ca3771a04def85215201203d9952c7 in 485ms, sequenceid=23, compaction requested=true 2023-10-29 23:55:29,118 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:29,118 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:29,118 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:29,492 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/1143bf84fee44eadac79dba2aff5de32 2023-10-29 23:55:29,496 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1143bf84fee44eadac79dba2aff5de32 2023-10-29 23:55:29,496 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5 2023-10-29 23:55:29,500 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f14ff72f05f4c0bbb4eebc46cadcbe5 2023-10-29 23:55:29,500 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:29,501 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/1143bf84fee44eadac79dba2aff5de32 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/1143bf84fee44eadac79dba2aff5de32 2023-10-29 23:55:29,505 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1143bf84fee44eadac79dba2aff5de32 2023-10-29 23:55:29,505 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/1143bf84fee44eadac79dba2aff5de32, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:29,506 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8062191887307ceea838f50b05ff311e in 879ms, sequenceid=23, compaction requested=true 2023-10-29 23:55:29,506 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:29,506 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 23:55:29,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 23:55:29,508 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,508 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:29,509 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,509 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:29,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:29,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 23:55:29,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aef82fc[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:29,515 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 23:55:29,515 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,516 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 23:55:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 23:55:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:29,516 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,516 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:29,518 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,518 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 23:55:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:29,518 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:29,518 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 23:55:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:29,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 23:55:29,520 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 23:55:29,520 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:29,520 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:29,520 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 23:55:29,520 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:29,530 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:29,530 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:29,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:29,530 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:29,531 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:29,533 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 23:55:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,538 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,538 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:29,538 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:29,538 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 23:55:29,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 23:55:29,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 23:55:29,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:29,539 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:29,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:29,639 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:29,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:29,640 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:29,640 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 8062191887307ceea838f50b05ff311e/family1 is initiating major compaction (all files) 2023-10-29 23:55:29,641 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:29,641 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:29,641 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 8062191887307ceea838f50b05ff311e/family1 in ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:29,641 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/2d358180af584b69bb19e2f3475b28af, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/1a7aa0867f7d41fc9f19d7facc8872d5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/275e48d4190f43989a82519bae3bf07f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4d41e318a62c49b0a4ac44c4cb3fd41b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp, totalSize=26.6 K 2023-10-29 23:55:29,641 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 2d358180af584b69bb19e2f3475b28af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623721748 2023-10-29 23:55:29,642 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 1a7aa0867f7d41fc9f19d7facc8872d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623723531 2023-10-29 23:55:29,642 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 275e48d4190f43989a82519bae3bf07f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623724933 2023-10-29 23:55:29,643 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 4d41e318a62c49b0a4ac44c4cb3fd41b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623726732 2023-10-29 23:55:29,643 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 4f14ff72f05f4c0bbb4eebc46cadcbe5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:29,653 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 8062191887307ceea838f50b05ff311e#family1#compaction#149 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:30,067 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310297551b656aad9470fa1b3589f945356d3_del 2023-10-29 23:55:30,067 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310297551b656aad9470fa1b3589f945356d3_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202310297551b656aad9470fa1b3589f945356d3_del 2023-10-29 23:55:30,487 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a10fdc1f465f4ce1a0c28ef1c719fa46 2023-10-29 23:55:30,488 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family1/a10fdc1f465f4ce1a0c28ef1c719fa46 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/a10fdc1f465f4ce1a0c28ef1c719fa46 2023-10-29 23:55:30,491 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a10fdc1f465f4ce1a0c28ef1c719fa46 2023-10-29 23:55:30,492 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8062191887307ceea838f50b05ff311e/family1 of 8062191887307ceea838f50b05ff311e into a10fdc1f465f4ce1a0c28ef1c719fa46(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:30,492 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:30,493 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:30,493 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 8062191887307ceea838f50b05ff311e/family2 is initiating major compaction (all files) 2023-10-29 23:55:30,493 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:30,493 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:30,493 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 8062191887307ceea838f50b05ff311e/family2 in ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:55:30,493 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/bc6c11abb4774d4ea2ecfb726bd96cc0, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/30c0137f79ca4570b7b8ad76bf01fd98, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/c15fa6fae1314c9baa27b7f157e3fe58, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/93c80871aef64d5d97693ad8edb00758, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/1143bf84fee44eadac79dba2aff5de32] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp, totalSize=25.3 K 2023-10-29 23:55:30,494 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting bc6c11abb4774d4ea2ecfb726bd96cc0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623721748 2023-10-29 23:55:30,494 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 30c0137f79ca4570b7b8ad76bf01fd98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623723531 2023-10-29 23:55:30,494 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting c15fa6fae1314c9baa27b7f157e3fe58, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623724933 2023-10-29 23:55:30,495 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 93c80871aef64d5d97693ad8edb00758, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623726732 2023-10-29 23:55:30,495 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 1143bf84fee44eadac79dba2aff5de32, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:30,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/2d358180af584b69bb19e2f3475b28af, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/1a7aa0867f7d41fc9f19d7facc8872d5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/275e48d4190f43989a82519bae3bf07f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4d41e318a62c49b0a4ac44c4cb3fd41b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5] to archive 2023-10-29 23:55:30,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:30,506 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 8062191887307ceea838f50b05ff311e#family2#compaction#150 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:30,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/2d358180af584b69bb19e2f3475b28af to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/2d358180af584b69bb19e2f3475b28af 2023-10-29 23:55:30,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/1a7aa0867f7d41fc9f19d7facc8872d5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/1a7aa0867f7d41fc9f19d7facc8872d5 2023-10-29 23:55:30,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/275e48d4190f43989a82519bae3bf07f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/275e48d4190f43989a82519bae3bf07f 2023-10-29 23:55:30,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4d41e318a62c49b0a4ac44c4cb3fd41b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4d41e318a62c49b0a4ac44c4cb3fd41b 2023-10-29 23:55:30,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/4f14ff72f05f4c0bbb4eebc46cadcbe5 2023-10-29 23:55:30,922 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310299a4e667d140749028d60f88756d7964b_del 2023-10-29 23:55:30,922 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310299a4e667d140749028d60f88756d7964b_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310299a4e667d140749028d60f88756d7964b_del 2023-10-29 23:55:30,933 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a26e17783a743c095c4d5047ddf3a7d 2023-10-29 23:55:30,934 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/.tmp/family2/7a26e17783a743c095c4d5047ddf3a7d as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/7a26e17783a743c095c4d5047ddf3a7d 2023-10-29 23:55:30,937 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a26e17783a743c095c4d5047ddf3a7d 2023-10-29 23:55:30,938 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8062191887307ceea838f50b05ff311e/family2 of 8062191887307ceea838f50b05ff311e into 7a26e17783a743c095c4d5047ddf3a7d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:30,938 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:30,938 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:30,939 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 9503a9edc2e7fdcd40523a76a7ac98fc/family1 is initiating major compaction (all files) 2023-10-29 23:55:30,939 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:30,939 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:30,940 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 9503a9edc2e7fdcd40523a76a7ac98fc/family1 in ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:30,940 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/2bb15235ff3a49659f8e6f86eb22392c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/317f9a21949b482f84b9000d808975b6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/d953b9c4044c4526ade69be19785946c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/29d8ed56db864fba8fe27a2afbcb7626, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/85590a2873c84cc7af611d52cb5ac04e] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp, totalSize=26.6 K 2023-10-29 23:55:30,940 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 2bb15235ff3a49659f8e6f86eb22392c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623721748 2023-10-29 23:55:30,941 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 317f9a21949b482f84b9000d808975b6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623723530 2023-10-29 23:55:30,941 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting d953b9c4044c4526ade69be19785946c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623724933 2023-10-29 23:55:30,941 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 29d8ed56db864fba8fe27a2afbcb7626, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623726731 2023-10-29 23:55:30,942 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 85590a2873c84cc7af611d52cb5ac04e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:30,950 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 9503a9edc2e7fdcd40523a76a7ac98fc#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:31,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/bc6c11abb4774d4ea2ecfb726bd96cc0, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/30c0137f79ca4570b7b8ad76bf01fd98, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/c15fa6fae1314c9baa27b7f157e3fe58, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/93c80871aef64d5d97693ad8edb00758, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/1143bf84fee44eadac79dba2aff5de32] to archive 2023-10-29 23:55:31,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:31,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/bc6c11abb4774d4ea2ecfb726bd96cc0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/bc6c11abb4774d4ea2ecfb726bd96cc0 2023-10-29 23:55:31,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/30c0137f79ca4570b7b8ad76bf01fd98 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/30c0137f79ca4570b7b8ad76bf01fd98 2023-10-29 23:55:31,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/c15fa6fae1314c9baa27b7f157e3fe58 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/c15fa6fae1314c9baa27b7f157e3fe58 2023-10-29 23:55:31,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/93c80871aef64d5d97693ad8edb00758 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/93c80871aef64d5d97693ad8edb00758 2023-10-29 23:55:31,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/1143bf84fee44eadac79dba2aff5de32 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family2/1143bf84fee44eadac79dba2aff5de32 2023-10-29 23:55:31,361 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029bec8de2885fd4e7a8a84ff7afcac675c_del 2023-10-29 23:55:31,361 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029bec8de2885fd4e7a8a84ff7afcac675c_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029bec8de2885fd4e7a8a84ff7afcac675c_del 2023-10-29 23:55:32,174 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e53d3f46c7dd4528a3a03e7e4f107460 2023-10-29 23:55:32,175 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family1/e53d3f46c7dd4528a3a03e7e4f107460 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/e53d3f46c7dd4528a3a03e7e4f107460 2023-10-29 23:55:32,179 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e53d3f46c7dd4528a3a03e7e4f107460 2023-10-29 23:55:32,180 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9503a9edc2e7fdcd40523a76a7ac98fc/family1 of 9503a9edc2e7fdcd40523a76a7ac98fc into e53d3f46c7dd4528a3a03e7e4f107460(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:32,180 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:32,180 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:32,180 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 9503a9edc2e7fdcd40523a76a7ac98fc/family2 is initiating major compaction (all files) 2023-10-29 23:55:32,180 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:32,180 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:32,181 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 9503a9edc2e7fdcd40523a76a7ac98fc/family2 in ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:55:32,181 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/6e457d656e8149f4afcaeca4314a5ba6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/dbb85193bd074e19a1fb8526335b45ee, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/240665802b794836aaffafce18bf9a01, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/361740550697450b84cb78edfe8016de, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/3a18822c463441d38937cb7e920f9d4d] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp, totalSize=25.3 K 2023-10-29 23:55:32,182 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 6e457d656e8149f4afcaeca4314a5ba6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623721748 2023-10-29 23:55:32,182 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting dbb85193bd074e19a1fb8526335b45ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623723530 2023-10-29 23:55:32,182 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 240665802b794836aaffafce18bf9a01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623724933 2023-10-29 23:55:32,183 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 361740550697450b84cb78edfe8016de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623726731 2023-10-29 23:55:32,183 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 3a18822c463441d38937cb7e920f9d4d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:32,193 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 9503a9edc2e7fdcd40523a76a7ac98fc#family2#compaction#152 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:32,201 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029a3901d4188be45f1bd21f7367dcc8872_del 2023-10-29 23:55:32,201 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029a3901d4188be45f1bd21f7367dcc8872_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231029a3901d4188be45f1bd21f7367dcc8872_del 2023-10-29 23:55:32,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/2bb15235ff3a49659f8e6f86eb22392c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/317f9a21949b482f84b9000d808975b6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/d953b9c4044c4526ade69be19785946c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/29d8ed56db864fba8fe27a2afbcb7626, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/85590a2873c84cc7af611d52cb5ac04e] to archive 2023-10-29 23:55:32,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:32,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/2bb15235ff3a49659f8e6f86eb22392c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/2bb15235ff3a49659f8e6f86eb22392c 2023-10-29 23:55:32,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/317f9a21949b482f84b9000d808975b6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/317f9a21949b482f84b9000d808975b6 2023-10-29 23:55:32,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/d953b9c4044c4526ade69be19785946c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/d953b9c4044c4526ade69be19785946c 2023-10-29 23:55:32,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/29d8ed56db864fba8fe27a2afbcb7626 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/29d8ed56db864fba8fe27a2afbcb7626 2023-10-29 23:55:32,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/85590a2873c84cc7af611d52cb5ac04e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/85590a2873c84cc7af611d52cb5ac04e 2023-10-29 23:55:32,618 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2a2a626b2e941a2be52e5c9d468a227 2023-10-29 23:55:32,618 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/.tmp/family2/c2a2a626b2e941a2be52e5c9d468a227 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/c2a2a626b2e941a2be52e5c9d468a227 2023-10-29 23:55:32,623 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2a2a626b2e941a2be52e5c9d468a227 2023-10-29 23:55:32,624 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9503a9edc2e7fdcd40523a76a7ac98fc/family2 of 9503a9edc2e7fdcd40523a76a7ac98fc into c2a2a626b2e941a2be52e5c9d468a227(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:32,624 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:32,624 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:32,624 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 27ca3771a04def85215201203d9952c7/family1 is initiating major compaction (all files) 2023-10-29 23:55:32,624 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:32,624 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:32,625 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 27ca3771a04def85215201203d9952c7/family1 in ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:32,625 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/e0ce81cd1c33412cabd4b1b2572cff00, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/b006e9e881674ea6bee91c49a80109d9, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/c0699854507d46a29f281d4dd8d0da57, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/a46276029e4b4f3d8dc260ee2f60789a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/26c0e0f64bec49b6b05f54ab2ff5b58b] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp, totalSize=26.6 K 2023-10-29 23:55:32,626 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting e0ce81cd1c33412cabd4b1b2572cff00, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623721748 2023-10-29 23:55:32,626 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting b006e9e881674ea6bee91c49a80109d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623723530 2023-10-29 23:55:32,627 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting c0699854507d46a29f281d4dd8d0da57, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623724933 2023-10-29 23:55:32,627 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting a46276029e4b4f3d8dc260ee2f60789a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623726731 2023-10-29 23:55:32,627 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 26c0e0f64bec49b6b05f54ab2ff5b58b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:32,638 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 27ca3771a04def85215201203d9952c7#family1#compaction#153 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:32,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/6e457d656e8149f4afcaeca4314a5ba6, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/dbb85193bd074e19a1fb8526335b45ee, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/240665802b794836aaffafce18bf9a01, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/361740550697450b84cb78edfe8016de, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/3a18822c463441d38937cb7e920f9d4d] to archive 2023-10-29 23:55:32,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:32,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/6e457d656e8149f4afcaeca4314a5ba6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/6e457d656e8149f4afcaeca4314a5ba6 2023-10-29 23:55:32,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/dbb85193bd074e19a1fb8526335b45ee to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/dbb85193bd074e19a1fb8526335b45ee 2023-10-29 23:55:32,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/240665802b794836aaffafce18bf9a01 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/240665802b794836aaffafce18bf9a01 2023-10-29 23:55:32,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/361740550697450b84cb78edfe8016de to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/361740550697450b84cb78edfe8016de 2023-10-29 23:55:32,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/3a18822c463441d38937cb7e920f9d4d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family2/3a18822c463441d38937cb7e920f9d4d 2023-10-29 23:55:33,047 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029c66406537bee474c9685d4fbf570dbbb_del 2023-10-29 23:55:33,047 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029c66406537bee474c9685d4fbf570dbbb_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231029c66406537bee474c9685d4fbf570dbbb_del 2023-10-29 23:55:33,860 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a352b9da263d4f1590e05a07bcd33c25 2023-10-29 23:55:33,860 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family1/a352b9da263d4f1590e05a07bcd33c25 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/a352b9da263d4f1590e05a07bcd33c25 2023-10-29 23:55:33,865 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a352b9da263d4f1590e05a07bcd33c25 2023-10-29 23:55:33,865 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 27ca3771a04def85215201203d9952c7/family1 of 27ca3771a04def85215201203d9952c7 into a352b9da263d4f1590e05a07bcd33c25(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:33,866 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:33,866 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:33,866 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 27ca3771a04def85215201203d9952c7/family2 is initiating major compaction (all files) 2023-10-29 23:55:33,866 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:33,866 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:33,867 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 27ca3771a04def85215201203d9952c7/family2 in ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:55:33,867 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/70deb18a4f39417a9ba444451d0fba96, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/8eefc9f00f1c482182f40cf60eacbb4e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/925ba2fb8ef941d59548d6865c4dc6d5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/a838a402a6cd4a23a3fbdb4f34c9d85e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/4dde8c54dcc84a0783792996159b293f] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp, totalSize=25.3 K 2023-10-29 23:55:33,867 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 70deb18a4f39417a9ba444451d0fba96, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623721748 2023-10-29 23:55:33,867 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 8eefc9f00f1c482182f40cf60eacbb4e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623723530 2023-10-29 23:55:33,868 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 925ba2fb8ef941d59548d6865c4dc6d5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623724933 2023-10-29 23:55:33,868 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting a838a402a6cd4a23a3fbdb4f34c9d85e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623726731 2023-10-29 23:55:33,868 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 4dde8c54dcc84a0783792996159b293f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:33,877 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 27ca3771a04def85215201203d9952c7#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:33,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/e0ce81cd1c33412cabd4b1b2572cff00, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/b006e9e881674ea6bee91c49a80109d9, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/c0699854507d46a29f281d4dd8d0da57, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/a46276029e4b4f3d8dc260ee2f60789a, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/26c0e0f64bec49b6b05f54ab2ff5b58b] to archive 2023-10-29 23:55:33,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:33,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/e0ce81cd1c33412cabd4b1b2572cff00 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/e0ce81cd1c33412cabd4b1b2572cff00 2023-10-29 23:55:33,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/b006e9e881674ea6bee91c49a80109d9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/b006e9e881674ea6bee91c49a80109d9 2023-10-29 23:55:33,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/c0699854507d46a29f281d4dd8d0da57 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/c0699854507d46a29f281d4dd8d0da57 2023-10-29 23:55:33,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/a46276029e4b4f3d8dc260ee2f60789a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/a46276029e4b4f3d8dc260ee2f60789a 2023-10-29 23:55:33,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/26c0e0f64bec49b6b05f54ab2ff5b58b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/26c0e0f64bec49b6b05f54ab2ff5b58b 2023-10-29 23:55:34,286 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023102961beecba72bc4e46a2e6db58b53e0817_del 2023-10-29 23:55:34,286 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102961beecba72bc4e46a2e6db58b53e0817_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023102961beecba72bc4e46a2e6db58b53e0817_del 2023-10-29 23:55:35,101 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48702fbf117f468ea84d2ef6695f568b 2023-10-29 23:55:35,102 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/.tmp/family2/48702fbf117f468ea84d2ef6695f568b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/48702fbf117f468ea84d2ef6695f568b 2023-10-29 23:55:35,106 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48702fbf117f468ea84d2ef6695f568b 2023-10-29 23:55:35,107 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 27ca3771a04def85215201203d9952c7/family2 of 27ca3771a04def85215201203d9952c7 into 48702fbf117f468ea84d2ef6695f568b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:55:35,107 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:35,110 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:35,112 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:35,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/70deb18a4f39417a9ba444451d0fba96, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/8eefc9f00f1c482182f40cf60eacbb4e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/925ba2fb8ef941d59548d6865c4dc6d5, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/a838a402a6cd4a23a3fbdb4f34c9d85e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/4dde8c54dcc84a0783792996159b293f] to archive 2023-10-29 23:55:35,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:35,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/70deb18a4f39417a9ba444451d0fba96 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/70deb18a4f39417a9ba444451d0fba96 2023-10-29 23:55:35,115 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:35,116 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:35,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/8eefc9f00f1c482182f40cf60eacbb4e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/8eefc9f00f1c482182f40cf60eacbb4e 2023-10-29 23:55:35,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/925ba2fb8ef941d59548d6865c4dc6d5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/925ba2fb8ef941d59548d6865c4dc6d5 2023-10-29 23:55:35,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/a838a402a6cd4a23a3fbdb4f34c9d85e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/a838a402a6cd4a23a3fbdb4f34c9d85e 2023-10-29 23:55:35,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/4dde8c54dcc84a0783792996159b293f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family2/4dde8c54dcc84a0783792996159b293f 2023-10-29 23:55:35,121 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 23:55:35,135 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-10-29 23:55:35,138 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029bec8de2885fd4e7a8a84ff7afcac675c_del 2023-10-29 23:55:35,141 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029c66406537bee474c9685d4fbf570dbbb_del 2023-10-29 23:55:35,144 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310297551b656aad9470fa1b3589f945356d3_del 2023-10-29 23:55:35,144 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:35,145 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(139): Connect 0x6ecedb36 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:55:35,149 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f9c3d50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:55:35,150 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 23:55:35,150 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 23:55:35,150 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 23:55:35,186 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102996cfbdc0c4314e99bab002936eb9d9c9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023102996cfbdc0c4314e99bab002936eb9d9c9 2023-10-29 23:55:35,187 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:35,208 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:55:35,210 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:55:35,217 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:55:35,221 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:55:35,230 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2c1d4f5b99634dccabc3afa8bb2c1aac first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-10-29 23:55:35,230 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2c1d4f5b99634dccabc3afa8bb2c1aac}] 2023-10-29 23:55:35,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2c1d4f5b99634dccabc3afa8bb2c1aac for inclusion in 27ca3771a04def85215201203d9952c7/family1 2023-10-29 23:55:35,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-10-29 23:55:35,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 23:55:35,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:55:35,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/2c1d4f5b99634dccabc3afa8bb2c1aac to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__8jda2cfnjdresunnva7kigulu39qrgub2mlfl405s3m199jcml0g82ja3c5obrt7/family1/2c1d4f5b99634dccabc3afa8bb2c1aac 2023-10-29 23:55:35,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__8jda2cfnjdresunnva7kigulu39qrgub2mlfl405s3m199jcml0g82ja3c5obrt7/family1/2c1d4f5b99634dccabc3afa8bb2c1aac as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/da10c403baa4422e98bc221591b93dff_SeqId_28_ 2023-10-29 23:55:35,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__8jda2cfnjdresunnva7kigulu39qrgub2mlfl405s3m199jcml0g82ja3c5obrt7/family1/2c1d4f5b99634dccabc3afa8bb2c1aac into 27ca3771a04def85215201203d9952c7/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/da10c403baa4422e98bc221591b93dff_SeqId_28_ - updating store file list. 2023-10-29 23:55:35,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/da10c403baa4422e98bc221591b93dff_SeqId_28_ into 27ca3771a04def85215201203d9952c7/family1 2023-10-29 23:55:35,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__8jda2cfnjdresunnva7kigulu39qrgub2mlfl405s3m199jcml0g82ja3c5obrt7/family1/2c1d4f5b99634dccabc3afa8bb2c1aac into 27ca3771a04def85215201203d9952c7/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/family1/da10c403baa4422e98bc221591b93dff_SeqId_28_) 2023-10-29 23:55:35,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__8jda2cfnjdresunnva7kigulu39qrgub2mlfl405s3m199jcml0g82ja3c5obrt7/family1/2c1d4f5b99634dccabc3afa8bb2c1aac 2023-10-29 23:55:35,249 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:35,249 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:35,251 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310299e5c3d16d00943b2a54b04dd36382334 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310299e5c3d16d00943b2a54b04dd36382334 2023-10-29 23:55:35,251 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 23:55:35,251 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 23:55:35,252 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 23:55:35,586 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029f0f51a2fa05c496bb9d3d56af9e3548c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029f0f51a2fa05c496bb9d3d56af9e3548c 2023-10-29 23:55:35,586 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:35,618 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/01983974da514a29acfb54e8f03db62f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-10-29 23:55:35,618 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/01983974da514a29acfb54e8f03db62f}] 2023-10-29 23:55:35,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/01983974da514a29acfb54e8f03db62f for inclusion in 9503a9edc2e7fdcd40523a76a7ac98fc/family1 2023-10-29 23:55:35,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-10-29 23:55:35,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 23:55:35,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:55:35,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/01983974da514a29acfb54e8f03db62f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__5bpvjmafj2luce61ogcrbh275kaov1rm7f1alt2c4nk1t8k93fm8hp00i9jtgqns/family1/01983974da514a29acfb54e8f03db62f 2023-10-29 23:55:35,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__5bpvjmafj2luce61ogcrbh275kaov1rm7f1alt2c4nk1t8k93fm8hp00i9jtgqns/family1/01983974da514a29acfb54e8f03db62f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/085244d25e7d496b977364102a3993ca_SeqId_28_ 2023-10-29 23:55:35,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__5bpvjmafj2luce61ogcrbh275kaov1rm7f1alt2c4nk1t8k93fm8hp00i9jtgqns/family1/01983974da514a29acfb54e8f03db62f into 9503a9edc2e7fdcd40523a76a7ac98fc/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/085244d25e7d496b977364102a3993ca_SeqId_28_ - updating store file list. 2023-10-29 23:55:35,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/085244d25e7d496b977364102a3993ca_SeqId_28_ into 9503a9edc2e7fdcd40523a76a7ac98fc/family1 2023-10-29 23:55:35,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__5bpvjmafj2luce61ogcrbh275kaov1rm7f1alt2c4nk1t8k93fm8hp00i9jtgqns/family1/01983974da514a29acfb54e8f03db62f into 9503a9edc2e7fdcd40523a76a7ac98fc/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/family1/085244d25e7d496b977364102a3993ca_SeqId_28_) 2023-10-29 23:55:35,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__5bpvjmafj2luce61ogcrbh275kaov1rm7f1alt2c4nk1t8k93fm8hp00i9jtgqns/family1/01983974da514a29acfb54e8f03db62f 2023-10-29 23:55:35,629 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:35,630 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:35,631 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029854914a048bd44629b7bb1b97ffa8402 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029854914a048bd44629b7bb1b97ffa8402 2023-10-29 23:55:35,631 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 23:55:35,631 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 23:55:35,631 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 23:55:35,984 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310290ea5f2b273a34d4482526fb6f98d9bf5 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202310290ea5f2b273a34d4482526fb6f98d9bf5 2023-10-29 23:55:35,985 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:36,011 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/0a212152eab04598bdbb4a92915c0f92 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-10-29 23:55:36,011 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/0a212152eab04598bdbb4a92915c0f92}] 2023-10-29 23:55:36,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/0a212152eab04598bdbb4a92915c0f92 for inclusion in 8062191887307ceea838f50b05ff311e/family1 2023-10-29 23:55:36,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-10-29 23:55:36,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 23:55:36,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:55:36,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/0a212152eab04598bdbb4a92915c0f92 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__9slqln9udanpatig506bnpggmgcgumc4ggqfopmud4crgbdbm1q7pqtev6asfhh5/family1/0a212152eab04598bdbb4a92915c0f92 2023-10-29 23:55:36,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__9slqln9udanpatig506bnpggmgcgumc4ggqfopmud4crgbdbm1q7pqtev6asfhh5/family1/0a212152eab04598bdbb4a92915c0f92 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/c8bc7c134c3246b8bc858fa3d7fe1ab6_SeqId_28_ 2023-10-29 23:55:36,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__9slqln9udanpatig506bnpggmgcgumc4ggqfopmud4crgbdbm1q7pqtev6asfhh5/family1/0a212152eab04598bdbb4a92915c0f92 into 8062191887307ceea838f50b05ff311e/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/c8bc7c134c3246b8bc858fa3d7fe1ab6_SeqId_28_ - updating store file list. 2023-10-29 23:55:36,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/c8bc7c134c3246b8bc858fa3d7fe1ab6_SeqId_28_ into 8062191887307ceea838f50b05ff311e/family1 2023-10-29 23:55:36,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__9slqln9udanpatig506bnpggmgcgumc4ggqfopmud4crgbdbm1q7pqtev6asfhh5/family1/0a212152eab04598bdbb4a92915c0f92 into 8062191887307ceea838f50b05ff311e/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/family1/c8bc7c134c3246b8bc858fa3d7fe1ab6_SeqId_28_) 2023-10-29 23:55:36,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__ns_testMinorCompaction__9slqln9udanpatig506bnpggmgcgumc4ggqfopmud4crgbdbm1q7pqtev6asfhh5/family1/0a212152eab04598bdbb4a92915c0f92 2023-10-29 23:55:36,024 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:36,025 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:36,026 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029feb6ab6521954fc0a2417c57af9cb644 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029feb6ab6521954fc0a2417c57af9cb644 2023-10-29 23:55:36,026 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 23:55:36,026 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 23:55:36,027 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 23:55:36,027 INFO [Listener at localhost/45261] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-10-29 23:55:36,029 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:36,030 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:36,033 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:36,033 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:36,051 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=256 (was 285), OpenFileDescriptor=642 (was 755), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 183) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=14399 (was 14066) - AvailableMemoryMB LEAK? - 2023-10-29 23:55:36,063 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=167, AvailableMemoryMB=14399 2023-10-29 23:55:36,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 23:55:36,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:36,067 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:55:36,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-10-29 23:55:36,068 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:55:36,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 23:55:36,069 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:36,069 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5 empty. 2023-10-29 23:55:36,070 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:36,070 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-10-29 23:55:36,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 23:55:36,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 23:55:36,479 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 23:55:36,494 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6901f72bd24459da3e941a35fa0c1eb5, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:55:36,494 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:55:36,495 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ecedb36 to 127.0.0.1:50259 2023-10-29 23:55:36,495 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:36,495 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:55:36,495 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x399b4bc6 to 127.0.0.1:50259 2023-10-29 23:55:36,496 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:36,496 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:55:36,496 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x150eb27f to 127.0.0.1:50259 2023-10-29 23:55:36,496 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:36,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 23:55:36,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:36,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 6901f72bd24459da3e941a35fa0c1eb5, disabling compactions & flushes 2023-10-29 23:55:36,900 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:36,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:36,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. after waiting 0 ms 2023-10-29 23:55:36,901 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:36,901 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:36,901 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:36,903 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:55:36,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698623736903"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623736903"}]},"ts":"1698623736903"} 2023-10-29 23:55:36,905 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 23:55:36,905 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:55:36,906 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623736905"}]},"ts":"1698623736905"} 2023-10-29 23:55:36,906 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-29 23:55:36,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6901f72bd24459da3e941a35fa0c1eb5, ASSIGN}] 2023-10-29 23:55:36,910 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6901f72bd24459da3e941a35fa0c1eb5, ASSIGN 2023-10-29 23:55:36,911 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6901f72bd24459da3e941a35fa0c1eb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:55:37,062 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=6901f72bd24459da3e941a35fa0c1eb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:37,062 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698623737062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623737062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623737062"}]},"ts":"1698623737062"} 2023-10-29 23:55:37,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 6901f72bd24459da3e941a35fa0c1eb5, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:37,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 23:55:37,215 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:37,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:37,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6901f72bd24459da3e941a35fa0c1eb5, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5.', STARTKEY => '', ENDKEY => ''} 2023-10-29 23:55:37,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:37,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:37,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:37,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:37,219 INFO [StoreOpener-6901f72bd24459da3e941a35fa0c1eb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:37,220 DEBUG [StoreOpener-6901f72bd24459da3e941a35fa0c1eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:37,220 DEBUG [StoreOpener-6901f72bd24459da3e941a35fa0c1eb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:37,220 INFO [StoreOpener-6901f72bd24459da3e941a35fa0c1eb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6901f72bd24459da3e941a35fa0c1eb5 columnFamilyName family1 2023-10-29 23:55:37,221 INFO [StoreOpener-6901f72bd24459da3e941a35fa0c1eb5-1] regionserver.HStore(310): Store=6901f72bd24459da3e941a35fa0c1eb5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:37,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:37,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:37,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:55:37,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:55:37,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6901f72bd24459da3e941a35fa0c1eb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66996572, jitterRate=-0.001673281192779541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 23:55:37,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:37,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5., pid=114, masterSystemTime=1698623737215 2023-10-29 23:55:37,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:37,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:37,229 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=6901f72bd24459da3e941a35fa0c1eb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:37,229 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698623737229"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623737229"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623737229"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623737229"}]},"ts":"1698623737229"} 2023-10-29 23:55:37,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-10-29 23:55:37,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 6901f72bd24459da3e941a35fa0c1eb5, server=jenkins-hbase4.apache.org,40533,1698623599827 in 166 msec 2023-10-29 23:55:37,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-10-29 23:55:37,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=6901f72bd24459da3e941a35fa0c1eb5, ASSIGN in 322 msec 2023-10-29 23:55:37,233 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:55:37,233 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623737233"}]},"ts":"1698623737233"} 2023-10-29 23:55:37,234 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-29 23:55:37,236 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:55:37,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1710 sec 2023-10-29 23:55:38,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 23:55:38,173 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-10-29 23:55:38,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:38,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,198 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:38,198 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:38,198 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:38,198 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:38,199 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,199 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,201 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:38,201 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:38,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:38,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:38,201 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:38,201 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:38,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:38,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,202 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:38,202 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:38,202 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:38,202 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:38,202 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:38,202 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:38,202 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:38,202 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:38,203 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 23:55:38,625 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113006d6d6271c3f48c39c49d7f04c70304e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113006d6d6271c3f48c39c49d7f04c70304e 2023-10-29 23:55:39,029 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/fcea3558085f4bd38cd9392b15200d9b 2023-10-29 23:55:39,033 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/fcea3558085f4bd38cd9392b15200d9b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/fcea3558085f4bd38cd9392b15200d9b 2023-10-29 23:55:39,036 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/fcea3558085f4bd38cd9392b15200d9b, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-29 23:55:39,037 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 834ms, sequenceid=5, compaction requested=false 2023-10-29 23:55:39,037 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:39,038 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:39,038 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:39,039 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,039 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:39,040 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,040 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:39,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:39,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dec63d5[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:39,041 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:39,041 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,042 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:39,043 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,043 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:39,044 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:39,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:39,046 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:39,046 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:39,046 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:39,046 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,046 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:39,048 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,048 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:39,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,048 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:39,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:39,049 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,050 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:39,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:55:39,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:39,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,052 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:39,053 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:39,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:39,153 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:39,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:39,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:39,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:39,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,159 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:39,159 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:39,159 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:39,159 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:39,159 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,159 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,160 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,160 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:39,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:39,161 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,161 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,161 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,162 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,162 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:39,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,162 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:39,162 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:39,162 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:39,162 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:39,162 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:39,162 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:39,162 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:39,162 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 23:55:39,575 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281a15ef664734423485bac2ad2b482abe to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281a15ef664734423485bac2ad2b482abe 2023-10-29 23:55:39,981 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/1806aa460fbe4a92bd066ff859527dbe 2023-10-29 23:55:39,985 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/1806aa460fbe4a92bd066ff859527dbe as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1806aa460fbe4a92bd066ff859527dbe 2023-10-29 23:55:39,988 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1806aa460fbe4a92bd066ff859527dbe, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 23:55:39,989 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 827ms, sequenceid=9, compaction requested=false 2023-10-29 23:55:39,989 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:39,989 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:39,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:39,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:39,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:39,989 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:39,990 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:39,990 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,991 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:39,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:39,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@327ae332[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:39,992 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:39,992 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,997 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,997 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:39,997 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:39,997 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,997 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:39,997 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:39,998 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,998 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:39,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:39,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:39,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:40,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:40,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:40,000 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:40,000 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:40,000 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:40,000 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,001 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:40,002 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,002 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:40,002 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:40,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:40,008 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,009 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:55:40,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:40,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,011 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:40,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:40,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:40,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:40,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:40,013 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:40,013 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:40,113 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:40,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:40,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:40,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:40,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,119 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:40,119 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:40,120 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:40,120 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:40,120 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,120 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,125 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,125 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:40,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:40,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:40,126 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,126 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:40,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:40,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,126 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,127 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:40,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,127 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:40,127 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:40,127 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:40,127 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:40,127 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:40,127 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:40,127 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:40,127 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:40,538 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c291efa3182c472da77484e49146447f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201c291efa3182c472da77484e49146447f 2023-10-29 23:55:40,943 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/d225793ccb3742c4b52fb95a45278eac 2023-10-29 23:55:40,948 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/d225793ccb3742c4b52fb95a45278eac as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d225793ccb3742c4b52fb95a45278eac 2023-10-29 23:55:40,952 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d225793ccb3742c4b52fb95a45278eac, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 23:55:40,953 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 826ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:40,953 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:40,953 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:40,953 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:40,955 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,955 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:40,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:40,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f70ecc7[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:40,956 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:40,956 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,957 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,958 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:40,958 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:40,958 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,958 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:40,958 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:40,959 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,959 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:40,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:40,961 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:40,961 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:40,961 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:40,961 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,962 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:40,964 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,964 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:40,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,965 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:40,965 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,966 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,968 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:40,968 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:40,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:40,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:40,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:40,969 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:40,969 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,069 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:41,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:41,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:41,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:41,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,075 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:41,075 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:41,075 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:41,075 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:41,076 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,076 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,077 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:41,077 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:41,077 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,077 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:41,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:41,078 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:41,079 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:41,079 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:41,079 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:41,489 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120501db7f1e7b4f42f0a0dd7c96407a0ff1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120501db7f1e7b4f42f0a0dd7c96407a0ff1 2023-10-29 23:55:41,894 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/5945ac4009734f879bd819c81523a3c0 2023-10-29 23:55:41,898 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/5945ac4009734f879bd819c81523a3c0 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/5945ac4009734f879bd819c81523a3c0 2023-10-29 23:55:41,901 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/5945ac4009734f879bd819c81523a3c0, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 23:55:41,902 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 823ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:41,902 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:41,902 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:41,902 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:41,902 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:41,902 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,902 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:41,902 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:41,904 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,904 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:41,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:41,904 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,904 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:41,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:41,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:41,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@793e6fb7[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:41,905 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:41,906 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,907 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:41,907 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:41,907 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,907 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:41,908 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,908 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:41,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:41,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:41,908 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:41,908 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:41,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:41,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:41,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:41,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:41,910 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:41,910 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:41,910 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:41,911 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,911 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:41,912 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,912 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:41,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,912 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:41,913 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,914 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:41,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:41,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:41,916 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:41,916 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:41,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:42,017 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:42,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:42,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:42,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:42,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,022 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:42,022 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:42,022 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:42,022 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:42,023 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,023 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,024 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:42,024 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:42,025 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,025 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,026 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,026 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:42,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:42,026 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:42,026 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:42,026 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:42,026 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:42,438 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b5694d7db1ba4d428427609cc05c8695 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228b5694d7db1ba4d428427609cc05c8695 2023-10-29 23:55:42,769 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:55:42,843 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/d1aaf8c8bb4d47ada38491ae4f6607bb 2023-10-29 23:55:42,847 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/d1aaf8c8bb4d47ada38491ae4f6607bb as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d1aaf8c8bb4d47ada38491ae4f6607bb 2023-10-29 23:55:42,851 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d1aaf8c8bb4d47ada38491ae4f6607bb, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 23:55:42,852 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 826ms, sequenceid=21, compaction requested=true 2023-10-29 23:55:42,852 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:42,852 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:42,852 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:42,854 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,854 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:42,854 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,854 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:42,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:42,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:42,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b2598e[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:42,855 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:42,856 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,856 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,857 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:42,857 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:42,857 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,857 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:42,857 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:42,858 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:42,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:42,858 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:42,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:42,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:42,860 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:42,860 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:42,860 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:42,860 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,860 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:42,863 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,863 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:42,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,863 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:42,863 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:42,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,864 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,868 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,868 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:42,868 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:42,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:42,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:42,868 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:42,868 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:42,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:55:42,869 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:42,868 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,869 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:42,869 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:42,869 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,869 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,869 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,969 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:42,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:42,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:42,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:42,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,975 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:42,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:42,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:42,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:42,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:42,977 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:42,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:42,977 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:42,977 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:42,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:42,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,978 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,978 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:42,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:42,978 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:42,978 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:42,978 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:42,979 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:43,390 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123167669dc1a57b476f85af26cb8b093cc4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123167669dc1a57b476f85af26cb8b093cc4 2023-10-29 23:55:43,795 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/3094a4342b534ffeabac8814766a10aa 2023-10-29 23:55:43,799 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/3094a4342b534ffeabac8814766a10aa as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/3094a4342b534ffeabac8814766a10aa 2023-10-29 23:55:43,802 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/3094a4342b534ffeabac8814766a10aa, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 23:55:43,802 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 823ms, sequenceid=25, compaction requested=true 2023-10-29 23:55:43,802 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:43,802 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:43,802 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:43,803 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:43,803 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,803 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:43,803 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:43,804 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,804 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:43,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:43,804 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,804 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:43,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:43,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:43,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:43,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:43,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62b44939[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:43,806 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:43,806 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,808 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:43,808 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,809 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:43,810 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:43,810 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:43,810 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,810 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:43,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:43,812 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:43,812 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:43,812 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:43,812 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,812 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:43,813 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,813 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:43,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:43,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,813 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:43,814 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,815 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,816 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,816 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,816 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,816 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,816 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,817 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,817 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:43,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:55:43,816 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:43,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:43,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:43,817 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,817 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:43,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:43,817 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:43,817 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:43,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:43,917 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:43,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:43,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:43,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:43,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,923 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:43,923 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:43,923 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:43,923 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:43,923 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,924 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,925 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:43,925 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:43,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:43,926 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:43,926 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:43,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:43,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,927 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:43,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:43,927 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:43,927 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:43,927 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:44,338 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010136ad89b6f6004e059169cf24bfd704cf to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010136ad89b6f6004e059169cf24bfd704cf 2023-10-29 23:55:44,342 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/ae9583481a034e888459f9cb6a2b1348 2023-10-29 23:55:44,345 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/ae9583481a034e888459f9cb6a2b1348 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/ae9583481a034e888459f9cb6a2b1348 2023-10-29 23:55:44,348 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/ae9583481a034e888459f9cb6a2b1348, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 23:55:44,349 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 422ms, sequenceid=29, compaction requested=true 2023-10-29 23:55:44,349 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:44,349 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:44,349 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:44,349 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:44,349 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,349 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:44,349 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:44,350 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,351 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:44,351 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,351 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:44,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:44,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aea877c[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:44,352 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:44,352 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,353 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,353 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,353 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:44,353 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:44,353 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:44,353 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:44,355 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,355 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:44,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:44,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:44,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:44,357 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:44,357 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:44,357 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:44,357 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,357 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:44,363 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,363 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,363 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:44,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:44,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:44,363 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,364 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,366 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,366 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:44,366 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,366 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:44,366 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:44,366 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:44,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:44,366 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:44,366 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:44,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,367 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,367 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:44,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:44,367 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:44,467 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:44,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:44,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:44,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:44,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,474 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:44,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:44,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:44,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:44,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,474 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,475 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,475 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:44,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:44,476 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,476 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,477 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,477 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:44,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,477 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:44,477 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:44,477 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:44,477 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:44,477 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:44,477 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:44,477 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:44,478 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:44,489 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103970adee277e142b38adb3f142ad7800c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103970adee277e142b38adb3f142ad7800c 2023-10-29 23:55:44,498 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/8ca232edf6414eb0a0c4b7dbe0405892 2023-10-29 23:55:44,502 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/8ca232edf6414eb0a0c4b7dbe0405892 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/8ca232edf6414eb0a0c4b7dbe0405892 2023-10-29 23:55:44,505 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/8ca232edf6414eb0a0c4b7dbe0405892, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 23:55:44,505 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 27ms, sequenceid=33, compaction requested=true 2023-10-29 23:55:44,506 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:44,506 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,507 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:44,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:44,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20231641[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:44,509 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:44,509 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,511 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,511 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:44,511 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:44,511 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,511 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:44,511 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:44,512 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:44,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:44,515 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:44,515 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:44,515 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:44,515 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,515 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:44,519 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,519 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:44,519 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:44,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:44,519 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,520 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,523 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:44,524 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:44,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:44,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:44,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:44,524 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:44,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:44,624 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:44,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:44,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:44,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:44,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,631 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:44,631 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:44,631 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:44,631 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:44,631 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,631 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,632 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,632 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:44,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:44,633 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:44,633 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:44,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,634 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,634 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:44,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:44,634 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:44,634 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:44,634 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:44,634 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:44,634 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:44,634 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:44,634 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:44,634 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:45,045 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907990cee1293c94eb8810f2258d96189c9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907990cee1293c94eb8810f2258d96189c9 2023-10-29 23:55:45,450 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/c22732e513af480ea1edaa70bc0295f3 2023-10-29 23:55:45,453 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/c22732e513af480ea1edaa70bc0295f3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/c22732e513af480ea1edaa70bc0295f3 2023-10-29 23:55:45,456 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/c22732e513af480ea1edaa70bc0295f3, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 23:55:45,457 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 823ms, sequenceid=37, compaction requested=true 2023-10-29 23:55:45,457 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:45,457 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:45,457 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:45,458 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:45,458 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,458 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:45,458 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:45,459 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:45,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:45,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35c855e2[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:45,461 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:45,461 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,462 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,462 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:45,462 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:45,462 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:45,462 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:45,464 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,464 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:45,465 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:45,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:45,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:45,467 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:45,467 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:45,467 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:45,467 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,467 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:45,468 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,468 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:45,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,468 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:45,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:45,469 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,470 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,472 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:45,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:45,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,472 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:45,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:45,473 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:45,573 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:45,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:45,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,578 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:45,578 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:45,578 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 23:55:45,578 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 23:55:45,579 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,579 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,580 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:45,580 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:45,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:45,580 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:45,580 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,581 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,581 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 23:55:45,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:45,581 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 23:55:45,581 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 23:55:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 23:55:45,582 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:45,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:45,582 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. started... 2023-10-29 23:55:45,582 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6901f72bd24459da3e941a35fa0c1eb5 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 23:55:45,993 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120672ec4977eaa49c49ed8f01ec9d44ebb to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120672ec4977eaa49c49ed8f01ec9d44ebb 2023-10-29 23:55:45,997 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/38be74c2641841b38de333a476729e73 2023-10-29 23:55:46,001 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/38be74c2641841b38de333a476729e73 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/38be74c2641841b38de333a476729e73 2023-10-29 23:55:46,004 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/38be74c2641841b38de333a476729e73, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 23:55:46,005 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6901f72bd24459da3e941a35fa0c1eb5 in 423ms, sequenceid=41, compaction requested=true 2023-10-29 23:55:46,005 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:46,005 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:46,005 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 23:55:46,005 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 23:55:46,005 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 23:55:46,006 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 23:55:46,008 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,008 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:46,008 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,008 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:46,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:46,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 23:55:46,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75f52fe3[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:46,010 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 23:55:46,010 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,011 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,011 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 23:55:46,011 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 23:55:46,011 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:46,011 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,011 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:46,012 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 23:55:46,012 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,012 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:46,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:46,013 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 23:55:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:46,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:46,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:46,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 23:55:46,015 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 23:55:46,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:46,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:46,015 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,015 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:46,016 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,016 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:46,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:46,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,017 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:46,017 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:46,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:46,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:46,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,018 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:46,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:46,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 23:55:46,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:46,021 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:46,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:46,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:46,021 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:46,022 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:46,122 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:46,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:46,124 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-10-29 23:55:46,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:55:46,126 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:55:46,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:55:46,126 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624346126 2023-10-29 23:55:46,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 23:55:46,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-29 23:55:46,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:46,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x12220ede to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:55:46,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a97dab7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:55:46,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:46,961 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f372fa89ce3c4fc880eca0c146cedb3a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103f372fa89ce3c4fc880eca0c146cedb3a 2023-10-29 23:55:46,963 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:46,975 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:55:46,977 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:55:46,982 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:55:46,983 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:55:46,990 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6aef8400966d45c6a56873a9314edeff first=Optional[r5] last=Optional[r6] 2023-10-29 23:55:46,990 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6aef8400966d45c6a56873a9314edeff}] 2023-10-29 23:55:46,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6aef8400966d45c6a56873a9314edeff for inclusion in 6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:46,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-29 23:55:46,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:55:46,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:46,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6aef8400966d45c6a56873a9314edeff to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lrc4u01lqlevb26i40gjkvnqfd5tb1227aqih4f2t9li85rt4g7ebn465ai6ofi3/family1/6aef8400966d45c6a56873a9314edeff 2023-10-29 23:55:47,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lrc4u01lqlevb26i40gjkvnqfd5tb1227aqih4f2t9li85rt4g7ebn465ai6ofi3/family1/6aef8400966d45c6a56873a9314edeff as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_ 2023-10-29 23:55:47,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lrc4u01lqlevb26i40gjkvnqfd5tb1227aqih4f2t9li85rt4g7ebn465ai6ofi3/family1/6aef8400966d45c6a56873a9314edeff into 6901f72bd24459da3e941a35fa0c1eb5/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_ - updating store file list. 2023-10-29 23:55:47,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_ into 6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:47,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lrc4u01lqlevb26i40gjkvnqfd5tb1227aqih4f2t9li85rt4g7ebn465ai6ofi3/family1/6aef8400966d45c6a56873a9314edeff into 6901f72bd24459da3e941a35fa0c1eb5/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_) 2023-10-29 23:55:47,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lrc4u01lqlevb26i40gjkvnqfd5tb1227aqih4f2t9li85rt4g7ebn465ai6ofi3/family1/6aef8400966d45c6a56873a9314edeff 2023-10-29 23:55:47,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 23:55:47,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 23:55:47,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 6901f72bd24459da3e941a35fa0c1eb5/family1 is initiating minor compaction 2023-10-29 23:55:47,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7fed0ef8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:47,007 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6901f72bd24459da3e941a35fa0c1eb5/family1 in testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:47,008 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1806aa460fbe4a92bd066ff859527dbe, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d225793ccb3742c4b52fb95a45278eac, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/5945ac4009734f879bd819c81523a3c0, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d1aaf8c8bb4d47ada38491ae4f6607bb, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/3094a4342b534ffeabac8814766a10aa, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/ae9583481a034e888459f9cb6a2b1348, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/8ca232edf6414eb0a0c4b7dbe0405892, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/c22732e513af480ea1edaa70bc0295f3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/38be74c2641841b38de333a476729e73, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp, totalSize=49.7 K 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1806aa460fbe4a92bd066ff859527dbe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d225793ccb3742c4b52fb95a45278eac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 5945ac4009734f879bd819c81523a3c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting d1aaf8c8bb4d47ada38491ae4f6607bb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 3094a4342b534ffeabac8814766a10aa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting ae9583481a034e888459f9cb6a2b1348, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 8ca232edf6414eb0a0c4b7dbe0405892, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting c22732e513af480ea1edaa70bc0295f3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 38be74c2641841b38de333a476729e73, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 23:55:47,008 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 1970412486164fa093a6a70408924aaf_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 23:55:47,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:47,010 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:47,012 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010136ad89b6f6004e059169cf24bfd704cf to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010136ad89b6f6004e059169cf24bfd704cf 2023-10-29 23:55:47,015 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103970adee277e142b38adb3f142ad7800c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103970adee277e142b38adb3f142ad7800c 2023-10-29 23:55:47,015 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-29 23:55:47,015 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-29 23:55:47,016 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:47,016 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:47,040 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6901f72bd24459da3e941a35fa0c1eb5#family1#compaction#165 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:47,074 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/6abaf6b339e940d0be1971389dbe0bfd as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6abaf6b339e940d0be1971389dbe0bfd 2023-10-29 23:55:47,077 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6901f72bd24459da3e941a35fa0c1eb5/family1 of 6901f72bd24459da3e941a35fa0c1eb5 into 6abaf6b339e940d0be1971389dbe0bfd(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:47,078 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:47,078 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698623747007; duration=0sec 2023-10-29 23:55:47,078 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:47,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1806aa460fbe4a92bd066ff859527dbe, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d225793ccb3742c4b52fb95a45278eac, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/5945ac4009734f879bd819c81523a3c0, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d1aaf8c8bb4d47ada38491ae4f6607bb, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/3094a4342b534ffeabac8814766a10aa, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/ae9583481a034e888459f9cb6a2b1348, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/8ca232edf6414eb0a0c4b7dbe0405892, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/c22732e513af480ea1edaa70bc0295f3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/38be74c2641841b38de333a476729e73, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_] to archive 2023-10-29 23:55:47,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:47,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1806aa460fbe4a92bd066ff859527dbe to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1806aa460fbe4a92bd066ff859527dbe 2023-10-29 23:55:47,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d225793ccb3742c4b52fb95a45278eac to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d225793ccb3742c4b52fb95a45278eac 2023-10-29 23:55:47,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/5945ac4009734f879bd819c81523a3c0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/5945ac4009734f879bd819c81523a3c0 2023-10-29 23:55:47,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d1aaf8c8bb4d47ada38491ae4f6607bb to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/d1aaf8c8bb4d47ada38491ae4f6607bb 2023-10-29 23:55:47,121 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/3094a4342b534ffeabac8814766a10aa to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/3094a4342b534ffeabac8814766a10aa 2023-10-29 23:55:47,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/ae9583481a034e888459f9cb6a2b1348 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/ae9583481a034e888459f9cb6a2b1348 2023-10-29 23:55:47,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/8ca232edf6414eb0a0c4b7dbe0405892 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/8ca232edf6414eb0a0c4b7dbe0405892 2023-10-29 23:55:47,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/c22732e513af480ea1edaa70bc0295f3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/c22732e513af480ea1edaa70bc0295f3 2023-10-29 23:55:47,124 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/38be74c2641841b38de333a476729e73 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/38be74c2641841b38de333a476729e73 2023-10-29 23:55:47,125 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/1970412486164fa093a6a70408924aaf_SeqId_44_ 2023-10-29 23:55:47,478 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123111fbe042308a4ee5a928dac9b8dba6dc to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123111fbe042308a4ee5a928dac9b8dba6dc 2023-10-29 23:55:47,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:47,500 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1268ecbba6aa493fad1a629245975d8b first=Optional[r1] last=Optional[r4] 2023-10-29 23:55:47,501 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1268ecbba6aa493fad1a629245975d8b}] 2023-10-29 23:55:47,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1268ecbba6aa493fad1a629245975d8b for inclusion in 6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:47,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-29 23:55:47,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:55:47,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:47,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1268ecbba6aa493fad1a629245975d8b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ju771iva7ph62tchn8fp4brifvn4nhq3o5r2d53iicnku91ivj2ci9p97jmg25dt/family1/1268ecbba6aa493fad1a629245975d8b 2023-10-29 23:55:47,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ju771iva7ph62tchn8fp4brifvn4nhq3o5r2d53iicnku91ivj2ci9p97jmg25dt/family1/1268ecbba6aa493fad1a629245975d8b as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_ 2023-10-29 23:55:47,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ju771iva7ph62tchn8fp4brifvn4nhq3o5r2d53iicnku91ivj2ci9p97jmg25dt/family1/1268ecbba6aa493fad1a629245975d8b into 6901f72bd24459da3e941a35fa0c1eb5/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_ - updating store file list. 2023-10-29 23:55:47,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_ into 6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:47,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ju771iva7ph62tchn8fp4brifvn4nhq3o5r2d53iicnku91ivj2ci9p97jmg25dt/family1/1268ecbba6aa493fad1a629245975d8b into 6901f72bd24459da3e941a35fa0c1eb5/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_) 2023-10-29 23:55:47,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ju771iva7ph62tchn8fp4brifvn4nhq3o5r2d53iicnku91ivj2ci9p97jmg25dt/family1/1268ecbba6aa493fad1a629245975d8b 2023-10-29 23:55:47,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 23:55:47,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 23:55:47,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(1912): 6901f72bd24459da3e941a35fa0c1eb5/family1 is initiating minor compaction (all files) 2023-10-29 23:55:47,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@46df2b18; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:47,515 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6901f72bd24459da3e941a35fa0c1eb5/family1 in testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:55:47,515 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/fcea3558085f4bd38cd9392b15200d9b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6abaf6b339e940d0be1971389dbe0bfd, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp, totalSize=178.1 K 2023-10-29 23:55:47,516 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting fcea3558085f4bd38cd9392b15200d9b, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823369 2023-10-29 23:55:47,516 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 6abaf6b339e940d0be1971389dbe0bfd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223369 2023-10-29 23:55:47,516 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] compactions.Compactor(207): Compacting 6f087c624bca4841bb1c2c55453b1cde_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223369 2023-10-29 23:55:47,517 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:47,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:47,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201c291efa3182c472da77484e49146447f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201c291efa3182c472da77484e49146447f 2023-10-29 23:55:47,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120501db7f1e7b4f42f0a0dd7c96407a0ff1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120501db7f1e7b4f42f0a0dd7c96407a0ff1 2023-10-29 23:55:47,521 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228b5694d7db1ba4d428427609cc05c8695 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228b5694d7db1ba4d428427609cc05c8695 2023-10-29 23:55:47,523 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123167669dc1a57b476f85af26cb8b093cc4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123167669dc1a57b476f85af26cb8b093cc4 2023-10-29 23:55:47,523 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-29 23:55:47,523 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-29 23:55:47,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:47,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:47,529 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6901f72bd24459da3e941a35fa0c1eb5#family1#compaction#166 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 23:55:47,560 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b7f79638004c4a79916f78ec9191d4ef to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b7f79638004c4a79916f78ec9191d4ef 2023-10-29 23:55:47,561 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:47,582 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 first=Optional[r00] last=Optional[r8] 2023-10-29 23:55:47,582 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a5c6fcc4ec743949e55dfac1c5c55c6}] 2023-10-29 23:55:47,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 for inclusion in 6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:47,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-29 23:55:47,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 23:55:47,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:47,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dr6pt2uus7k2347ofe7ie8gjb2vesrthsggdui4kn3dpt7g8q489jkksjsm3que3/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 2023-10-29 23:55:47,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dr6pt2uus7k2347ofe7ie8gjb2vesrthsggdui4kn3dpt7g8q489jkksjsm3que3/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/2a8596757b004a46b8a7e0df5230d947_SeqId_49_ 2023-10-29 23:55:47,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dr6pt2uus7k2347ofe7ie8gjb2vesrthsggdui4kn3dpt7g8q489jkksjsm3que3/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 into 6901f72bd24459da3e941a35fa0c1eb5/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/2a8596757b004a46b8a7e0df5230d947_SeqId_49_ - updating store file list. 2023-10-29 23:55:47,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/2a8596757b004a46b8a7e0df5230d947_SeqId_49_ into 6901f72bd24459da3e941a35fa0c1eb5/family1 2023-10-29 23:55:47,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dr6pt2uus7k2347ofe7ie8gjb2vesrthsggdui4kn3dpt7g8q489jkksjsm3que3/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 into 6901f72bd24459da3e941a35fa0c1eb5/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/2a8596757b004a46b8a7e0df5230d947_SeqId_49_) 2023-10-29 23:55:47,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dr6pt2uus7k2347ofe7ie8gjb2vesrthsggdui4kn3dpt7g8q489jkksjsm3que3/family1/2a5c6fcc4ec743949e55dfac1c5c55c6 2023-10-29 23:55:47,594 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:47,594 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:47,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120672ec4977eaa49c49ed8f01ec9d44ebb to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120672ec4977eaa49c49ed8f01ec9d44ebb 2023-10-29 23:55:47,597 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281a15ef664734423485bac2ad2b482abe to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281a15ef664734423485bac2ad2b482abe 2023-10-29 23:55:47,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113006d6d6271c3f48c39c49d7f04c70304e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113006d6d6271c3f48c39c49d7f04c70304e 2023-10-29 23:55:47,598 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-29 23:55:47,598 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 23:55:47,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:47,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:47,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 23:55:47,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 23:55:47,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:55:47,600 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 23:55:47,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4760 sec 2023-10-29 23:55:47,810 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=262 (was 256) - Thread LEAK? -, OpenFileDescriptor=652 (was 642) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=174 (was 187), ProcessCount=166 (was 167), AvailableMemoryMB=14496 (was 14399) - AvailableMemoryMB LEAK? - 2023-10-29 23:55:47,824 INFO [Listener at localhost/45261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=262, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=166, AvailableMemoryMB=14496 2023-10-29 23:55:47,843 DEBUG [Listener at localhost/45261] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-10-29 23:55:47,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC2`Y,H]4=\x1B\xA28\xF2b6\x01\xC0"\x10\x12\x9C#4\xF2\xEC\x9D"_\xAA*\xDE\x12\xF5)\xD9*\x10\x04\xEEZ^\xDCkq.\xC4\xA8d\x8F\xC9\xA3\x10\xA42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 23:55:47,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-10-29 23:55:47,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 23:55:47,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-10-29 23:55:47,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 23:55:47,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 23:55:47,900 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:47,900 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:47,900 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:47,900 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d empty. 2023-10-29 23:55:47,900 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378 empty. 2023-10-29 23:55:47,900 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9 empty. 2023-10-29 23:55:47,901 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:47,901 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:47,901 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:47,901 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-10-29 23:55:47,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 23:55:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 23:55:48,311 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-10-29 23:55:48,312 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3247d44a56444f401fcc527a3b3c98d9, NAME => 'testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC2`Y,H]4=\x1B\xA28\xF2b6\x01\xC0"\x10\x12\x9C#4\xF2\xEC\x9D"_\xAA*\xDE\x12\xF5)\xD9*\x10\x04\xEEZ^\xDCkq.\xC4\xA8d\x8F\xC9\xA3\x10\xA42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:55:48,313 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => e03872693a60a2886e33b94dc392f86d, NAME => 'testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC2`Y,H]4=\x1B\xA28\xF2b6\x01\xC0"\x10\x12\x9C#4\xF2\xEC\x9D"_\xAA*\xDE\x12\xF5)\xD9*\x10\x04\xEEZ^\xDCkq.\xC4\xA8d\x8F\xC9\xA3\x10\xA42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:55:48,313 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 264d801565ac50ccab63a80bae8e2378, NAME => 'testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC2`Y,H]4=\x1B\xA28\xF2b6\x01\xC0"\x10\x12\x9C#4\xF2\xEC\x9D"_\xAA*\xDE\x12\xF5)\xD9*\x10\x04\xEEZ^\xDCkq.\xC4\xA8d\x8F\xC9\xA3\x10\xA42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/.tmp 2023-10-29 23:55:48,318 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:48,318 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:48,318 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 3247d44a56444f401fcc527a3b3c98d9, disabling compactions & flushes 2023-10-29 23:55:48,318 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 264d801565ac50ccab63a80bae8e2378, disabling compactions & flushes 2023-10-29 23:55:48,318 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:48,318 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. after waiting 0 ms 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. after waiting 0 ms 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:48,319 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:48,319 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:48,319 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:55:48,349 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/.tmp/family1/78dc054bef544d599ce78a64885fc9f8 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/78dc054bef544d599ce78a64885fc9f8 2023-10-29 23:55:48,352 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6901f72bd24459da3e941a35fa0c1eb5/family1 of 6901f72bd24459da3e941a35fa0c1eb5 into 78dc054bef544d599ce78a64885fc9f8(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:48,352 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:55:48,353 INFO [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698623747515; duration=0sec 2023-10-29 23:55:48,353 DEBUG [RS:0;jenkins-hbase4:40533-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 23:55:48,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/fcea3558085f4bd38cd9392b15200d9b, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6abaf6b339e940d0be1971389dbe0bfd, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_] to archive 2023-10-29 23:55:48,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:48,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/fcea3558085f4bd38cd9392b15200d9b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/fcea3558085f4bd38cd9392b15200d9b 2023-10-29 23:55:48,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6abaf6b339e940d0be1971389dbe0bfd to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6abaf6b339e940d0be1971389dbe0bfd 2023-10-29 23:55:48,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_ to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/family1/6f087c624bca4841bb1c2c55453b1cde_SeqId_47_ 2023-10-29 23:55:48,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 23:55:48,718 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:48,718 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing e03872693a60a2886e33b94dc392f86d, disabling compactions & flushes 2023-10-29 23:55:48,718 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:48,718 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:48,718 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. after waiting 0 ms 2023-10-29 23:55:48,718 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:48,718 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:48,718 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:48,721 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 23:55:48,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698623748721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623748721"}]},"ts":"1698623748721"} 2023-10-29 23:55:48,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623748721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623748721"}]},"ts":"1698623748721"} 2023-10-29 23:55:48,722 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623748721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698623748721"}]},"ts":"1698623748721"} 2023-10-29 23:55:48,723 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 23:55:48,724 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 23:55:48,724 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623748724"}]},"ts":"1698623748724"} 2023-10-29 23:55:48,725 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-10-29 23:55:48,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e03872693a60a2886e33b94dc392f86d, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=264d801565ac50ccab63a80bae8e2378, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3247d44a56444f401fcc527a3b3c98d9, ASSIGN}] 2023-10-29 23:55:48,729 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e03872693a60a2886e33b94dc392f86d, ASSIGN 2023-10-29 23:55:48,729 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3247d44a56444f401fcc527a3b3c98d9, ASSIGN 2023-10-29 23:55:48,730 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=264d801565ac50ccab63a80bae8e2378, ASSIGN 2023-10-29 23:55:48,730 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e03872693a60a2886e33b94dc392f86d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:55:48,730 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=264d801565ac50ccab63a80bae8e2378, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:55:48,730 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3247d44a56444f401fcc527a3b3c98d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40533,1698623599827; forceNewPlan=false, retain=false 2023-10-29 23:55:48,882 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3247d44a56444f401fcc527a3b3c98d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:48,882 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=264d801565ac50ccab63a80bae8e2378, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:48,882 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623748882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623748882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623748882"}]},"ts":"1698623748882"} 2023-10-29 23:55:48,882 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e03872693a60a2886e33b94dc392f86d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:48,882 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698623748882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623748882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623748882"}]},"ts":"1698623748882"} 2023-10-29 23:55:48,883 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623748882"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698623748882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698623748882"}]},"ts":"1698623748882"} 2023-10-29 23:55:48,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 3247d44a56444f401fcc527a3b3c98d9, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:48,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 264d801565ac50ccab63a80bae8e2378, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:48,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure e03872693a60a2886e33b94dc392f86d, server=jenkins-hbase4.apache.org,40533,1698623599827}] 2023-10-29 23:55:49,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 23:55:49,037 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:49,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:49,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3247d44a56444f401fcc527a3b3c98d9, NAME => 'testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 23:55:49,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:49,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,061 INFO [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,063 DEBUG [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1 2023-10-29 23:55:49,063 DEBUG [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1 2023-10-29 23:55:49,063 INFO [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3247d44a56444f401fcc527a3b3c98d9 columnFamilyName family1 2023-10-29 23:55:49,064 INFO [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] regionserver.HStore(310): Store=3247d44a56444f401fcc527a3b3c98d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:49,064 INFO [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,066 DEBUG [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2 2023-10-29 23:55:49,066 DEBUG [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2 2023-10-29 23:55:49,066 INFO [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3247d44a56444f401fcc527a3b3c98d9 columnFamilyName family2 2023-10-29 23:55:49,067 INFO [StoreOpener-3247d44a56444f401fcc527a3b3c98d9-1] regionserver.HStore(310): Store=3247d44a56444f401fcc527a3b3c98d9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:49,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:49,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:55:49,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:55:49,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3247d44a56444f401fcc527a3b3c98d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59338716, jitterRate=-0.11578422784805298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:49,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:55:49,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9., pid=120, masterSystemTime=1698623749037 2023-10-29 23:55:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:49,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:49,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e03872693a60a2886e33b94dc392f86d, NAME => 'testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 23:55:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,074 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3247d44a56444f401fcc527a3b3c98d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,074 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623749074"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623749074"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623749074"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623749074"}]},"ts":"1698623749074"} 2023-10-29 23:55:49,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=119 2023-10-29 23:55:49,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 3247d44a56444f401fcc527a3b3c98d9, server=jenkins-hbase4.apache.org,40533,1698623599827 in 191 msec 2023-10-29 23:55:49,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3247d44a56444f401fcc527a3b3c98d9, ASSIGN in 348 msec 2023-10-29 23:55:49,094 INFO [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,095 DEBUG [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1 2023-10-29 23:55:49,096 DEBUG [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1 2023-10-29 23:55:49,096 INFO [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e03872693a60a2886e33b94dc392f86d columnFamilyName family1 2023-10-29 23:55:49,097 INFO [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] regionserver.HStore(310): Store=e03872693a60a2886e33b94dc392f86d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:49,097 INFO [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,098 DEBUG [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2 2023-10-29 23:55:49,098 DEBUG [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2 2023-10-29 23:55:49,098 INFO [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e03872693a60a2886e33b94dc392f86d columnFamilyName family2 2023-10-29 23:55:49,099 INFO [StoreOpener-e03872693a60a2886e33b94dc392f86d-1] regionserver.HStore(310): Store=e03872693a60a2886e33b94dc392f86d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:49,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:49,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e03872693a60a2886e33b94dc392f86d 2023-10-29 23:55:49,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:55:49,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e03872693a60a2886e33b94dc392f86d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70709409, jitterRate=0.05365230143070221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:49,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:49,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d., pid=122, masterSystemTime=1698623749037 2023-10-29 23:55:49,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:49,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:49,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:49,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 264d801565ac50ccab63a80bae8e2378, NAME => 'testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 23:55:49,106 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e03872693a60a2886e33b94dc392f86d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:49,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,106 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698623749106"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623749106"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623749106"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623749106"}]},"ts":"1698623749106"} 2023-10-29 23:55:49,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 23:55:49,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=117 2023-10-29 23:55:49,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure e03872693a60a2886e33b94dc392f86d, server=jenkins-hbase4.apache.org,40533,1698623599827 in 221 msec 2023-10-29 23:55:49,109 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e03872693a60a2886e33b94dc392f86d, ASSIGN in 380 msec 2023-10-29 23:55:49,126 INFO [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,127 DEBUG [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1 2023-10-29 23:55:49,127 DEBUG [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1 2023-10-29 23:55:49,128 INFO [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 264d801565ac50ccab63a80bae8e2378 columnFamilyName family1 2023-10-29 23:55:49,128 INFO [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] regionserver.HStore(310): Store=264d801565ac50ccab63a80bae8e2378/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:49,129 INFO [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,130 DEBUG [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2 2023-10-29 23:55:49,130 DEBUG [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2 2023-10-29 23:55:49,131 INFO [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 264d801565ac50ccab63a80bae8e2378 columnFamilyName family2 2023-10-29 23:55:49,131 INFO [StoreOpener-264d801565ac50ccab63a80bae8e2378-1] regionserver.HStore(310): Store=264d801565ac50ccab63a80bae8e2378/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 23:55:49,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 23:55:49,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 264d801565ac50ccab63a80bae8e2378 2023-10-29 23:55:49,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 23:55:49,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 264d801565ac50ccab63a80bae8e2378; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72514766, jitterRate=0.08055421710014343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 23:55:49,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:49,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378., pid=121, masterSystemTime=1698623749037 2023-10-29 23:55:49,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:49,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:49,140 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=264d801565ac50ccab63a80bae8e2378, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:49,140 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698623749140"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698623749140"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698623749140"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698623749140"}]},"ts":"1698623749140"} 2023-10-29 23:55:49,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-10-29 23:55:49,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 264d801565ac50ccab63a80bae8e2378, server=jenkins-hbase4.apache.org,40533,1698623599827 in 258 msec 2023-10-29 23:55:49,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-29 23:55:49,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=264d801565ac50ccab63a80bae8e2378, ASSIGN in 415 msec 2023-10-29 23:55:49,145 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 23:55:49,145 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698623749145"}]},"ts":"1698623749145"} 2023-10-29 23:55:49,146 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-10-29 23:55:49,152 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 23:55:49,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2570 sec 2023-10-29 23:55:50,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 23:55:50,003 INFO [Listener at localhost/45261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-10-29 23:55:50,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:50,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:50,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:50,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:50,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 23:55:50,016 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 23:55:50,016 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:50,016 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 23:55:50,016 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 23:55:50,017 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,017 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:50,020 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:50,020 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:50,020 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,020 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:50,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:50,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 23:55:50,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 23:55:50,021 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 23:55:50,021 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:50,021 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 23:55:50,022 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:50,022 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:50,022 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:50,022 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. started... 2023-10-29 23:55:50,022 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:50,022 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. started... 2023-10-29 23:55:50,022 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. started... 2023-10-29 23:55:50,022 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 264d801565ac50ccab63a80bae8e2378 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:55:50,022 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:50,023 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3247d44a56444f401fcc527a3b3c98d9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:55:50,023 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e03872693a60a2886e33b94dc392f86d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 23:55:50,073 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310297a3c9bfa3ef74ddbbbf566c15d851097 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310297a3c9bfa3ef74ddbbbf566c15d851097 2023-10-29 23:55:50,076 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029b003486814014f06adf9068c0c6e67ef to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029b003486814014f06adf9068c0c6e67ef 2023-10-29 23:55:50,082 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029d386bde8d6504e3398cda3824281e799 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029d386bde8d6504e3398cda3824281e799 2023-10-29 23:55:50,096 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/022f936e52c04880a80a242647b27c53 2023-10-29 23:55:50,104 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/6a728354d3dd43c487af25187b18d24c 2023-10-29 23:55:50,145 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310295138eb39442f4e28bdcf3c110330eb5a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310295138eb39442f4e28bdcf3c110330eb5a 2023-10-29 23:55:50,145 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029dc7636418aee4fdf8357ea4ef995112d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029dc7636418aee4fdf8357ea4ef995112d 2023-10-29 23:55:50,152 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/b1dc3c992fb643b785b69e4314383bb9 2023-10-29 23:55:50,156 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/6a728354d3dd43c487af25187b18d24c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/6a728354d3dd43c487af25187b18d24c 2023-10-29 23:55:50,179 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/6a728354d3dd43c487af25187b18d24c, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 23:55:50,180 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/b1dc3c992fb643b785b69e4314383bb9 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/b1dc3c992fb643b785b69e4314383bb9 2023-10-29 23:55:50,182 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/b1dc3c992fb643b785b69e4314383bb9, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:55:50,183 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e03872693a60a2886e33b94dc392f86d in 160ms, sequenceid=5, compaction requested=false 2023-10-29 23:55:50,183 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-29 23:55:50,184 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:50,184 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:50,184 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:50,490 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/4407e147c5a84755a0732c14fbd2ddb8 2023-10-29 23:55:50,524 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102964b99e7f34e54977ad826fd720547eb2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023102964b99e7f34e54977ad826fd720547eb2 2023-10-29 23:55:50,552 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/7853ddc08a664c908db9cea33cda1206 2023-10-29 23:55:50,556 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/022f936e52c04880a80a242647b27c53 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/022f936e52c04880a80a242647b27c53 2023-10-29 23:55:50,579 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/022f936e52c04880a80a242647b27c53, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 23:55:50,580 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/7853ddc08a664c908db9cea33cda1206 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/7853ddc08a664c908db9cea33cda1206 2023-10-29 23:55:50,583 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/7853ddc08a664c908db9cea33cda1206, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:55:50,584 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 264d801565ac50ccab63a80bae8e2378 in 562ms, sequenceid=5, compaction requested=false 2023-10-29 23:55:50,585 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:50,585 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:50,930 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/f9200c95d07149309e2bc50204909d14 2023-10-29 23:55:50,933 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/4407e147c5a84755a0732c14fbd2ddb8 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/4407e147c5a84755a0732c14fbd2ddb8 2023-10-29 23:55:50,957 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/4407e147c5a84755a0732c14fbd2ddb8, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 23:55:50,958 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/f9200c95d07149309e2bc50204909d14 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/f9200c95d07149309e2bc50204909d14 2023-10-29 23:55:50,961 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/f9200c95d07149309e2bc50204909d14, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 23:55:50,962 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3247d44a56444f401fcc527a3b3c98d9 in 939ms, sequenceid=5, compaction requested=false 2023-10-29 23:55:50,962 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:55:50,962 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:50,962 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:50,962 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:50,962 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,962 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 23:55:50,962 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 23:55:50,964 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,964 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:50,964 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,964 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:50,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 23:55:50,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b5a8746[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:50,966 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 23:55:50,966 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,968 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 23:55:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 23:55:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:50,969 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,969 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:50,970 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 23:55:50,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:50,970 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 23:55:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:50,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:50,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:50,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:50,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:50,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:50,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 23:55:50,972 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 23:55:50,972 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:50,972 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:50,972 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 23:55:50,972 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:50,974 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,974 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:50,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,974 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:50,974 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:50,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,975 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:50,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:50,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:50,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:50,977 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:50,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:50,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 23:55:50,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:50,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:50,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:50,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:50,977 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:50,978 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,978 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:50,978 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:50,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 23:55:50,978 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:50,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:50,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:50,978 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:51,078 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:51,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:51,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:51,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:51,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:51,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:51,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:51,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 23:55:51,084 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 23:55:51,084 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:51,084 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 23:55:51,084 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 23:55:51,085 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:51,085 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:51,087 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:51,087 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:51,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:51,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:51,087 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:51,088 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:51,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:51,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:51,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:51,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:51,088 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 23:55:51,088 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 23:55:51,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 23:55:51,089 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 23:55:51,089 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:51,089 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 23:55:51,089 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:51,089 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:51,089 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:51,089 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:51,089 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. started... 2023-10-29 23:55:51,089 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:51,089 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. started... 2023-10-29 23:55:51,089 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. started... 2023-10-29 23:55:51,089 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 264d801565ac50ccab63a80bae8e2378 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:55:51,089 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3247d44a56444f401fcc527a3b3c98d9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:55:51,089 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e03872693a60a2886e33b94dc392f86d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 23:55:51,531 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029f11a5770c1cd4f3cbf9c7c4dc1bf720b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f11a5770c1cd4f3cbf9c7c4dc1bf720b 2023-10-29 23:55:51,538 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310292d697b0b6c9c4ab88e2698ac51fcee74 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310292d697b0b6c9c4ab88e2698ac51fcee74 2023-10-29 23:55:51,545 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/51d81e26809c4f8a82def5caa1c05318 2023-10-29 23:55:51,549 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310296ab22123a6214c348fac1c1f87f63272 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310296ab22123a6214c348fac1c1f87f63272 2023-10-29 23:55:51,556 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/9794d6c50d0540d48320e649a43de9d1 2023-10-29 23:55:51,564 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/7079bc72f1ef464f8f39dd9f5fa45208 2023-10-29 23:55:51,580 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310291413035ca3cb4da1acfc9f0d581c4e1f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310291413035ca3cb4da1acfc9f0d581c4e1f 2023-10-29 23:55:51,590 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/de8f7ff0130e47629922c7b2b34750b3 2023-10-29 23:55:51,596 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/51d81e26809c4f8a82def5caa1c05318 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/51d81e26809c4f8a82def5caa1c05318 2023-10-29 23:55:51,604 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310296cbe113b13f9424c8c5691ece001e94a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202310296cbe113b13f9424c8c5691ece001e94a 2023-10-29 23:55:51,610 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/4421e14722ef4c74b9b361dab8cfc3ce 2023-10-29 23:55:51,613 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/7079bc72f1ef464f8f39dd9f5fa45208 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/7079bc72f1ef464f8f39dd9f5fa45208 2023-10-29 23:55:51,632 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/51d81e26809c4f8a82def5caa1c05318, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 23:55:51,633 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/de8f7ff0130e47629922c7b2b34750b3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/de8f7ff0130e47629922c7b2b34750b3 2023-10-29 23:55:51,636 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/de8f7ff0130e47629922c7b2b34750b3, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:55:51,637 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 264d801565ac50ccab63a80bae8e2378 in 548ms, sequenceid=9, compaction requested=false 2023-10-29 23:55:51,637 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:51,637 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:51,637 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:51,644 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/7079bc72f1ef464f8f39dd9f5fa45208, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 23:55:51,645 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/4421e14722ef4c74b9b361dab8cfc3ce as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/4421e14722ef4c74b9b361dab8cfc3ce 2023-10-29 23:55:51,648 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/4421e14722ef4c74b9b361dab8cfc3ce, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:55:51,648 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e03872693a60a2886e33b94dc392f86d in 559ms, sequenceid=9, compaction requested=false 2023-10-29 23:55:51,649 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:51,649 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:51,649 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:52,010 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310294a8fd0de2270496fb8e043733aaef604 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310294a8fd0de2270496fb8e043733aaef604 2023-10-29 23:55:52,415 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/3da6c412377745609cbe971f775b287e 2023-10-29 23:55:52,418 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/9794d6c50d0540d48320e649a43de9d1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/9794d6c50d0540d48320e649a43de9d1 2023-10-29 23:55:52,442 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/9794d6c50d0540d48320e649a43de9d1, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 23:55:52,443 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/3da6c412377745609cbe971f775b287e as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/3da6c412377745609cbe971f775b287e 2023-10-29 23:55:52,446 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/3da6c412377745609cbe971f775b287e, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 23:55:52,447 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3247d44a56444f401fcc527a3b3c98d9 in 1358ms, sequenceid=9, compaction requested=false 2023-10-29 23:55:52,447 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:55:52,447 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 23:55:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 23:55:52,449 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:52,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:52,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,449 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:52,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:52,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:52,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:52,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:52,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 23:55:52,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33731972[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:52,450 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 23:55:52,450 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,451 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 23:55:52,452 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 23:55:52,452 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:52,453 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 23:55:52,453 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:52,453 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,453 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 23:55:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:52,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 23:55:52,455 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 23:55:52,455 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:52,456 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:52,456 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 23:55:52,456 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:52,458 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,458 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,458 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:52,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,459 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:52,460 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:52,462 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:52,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 23:55:52,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:52,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:52,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 23:55:52,463 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,462 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:52,563 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:52,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:52,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:52,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:52,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:52,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:52,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:52,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 23:55:52,569 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 23:55:52,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:52,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 23:55:52,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 23:55:52,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,569 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:52,571 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:52,571 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:52,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:52,571 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:52,571 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:52,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:52,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:52,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:52,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:52,572 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 23:55:52,572 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 23:55:52,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 23:55:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 23:55:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 23:55:52,572 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:52,572 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. started... 2023-10-29 23:55:52,573 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e03872693a60a2886e33b94dc392f86d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:55:52,576 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:52,576 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. started... 2023-10-29 23:55:52,576 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 264d801565ac50ccab63a80bae8e2378 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:55:52,576 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:52,576 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:52,576 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:52,576 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. started... 2023-10-29 23:55:52,576 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3247d44a56444f401fcc527a3b3c98d9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 23:55:52,629 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310292d4e272c405b4a4d81dc022fbfd37245 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310292d4e272c405b4a4d81dc022fbfd37245 2023-10-29 23:55:53,018 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310293307004e540c4003a4f82d64dd4aa833 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293307004e540c4003a4f82d64dd4aa833 2023-10-29 23:55:53,022 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310292993854034404994acca3798a6a8639e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310292993854034404994acca3798a6a8639e 2023-10-29 23:55:53,035 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/a7cb41b5bbc64d1bbc1a040c457f1482 2023-10-29 23:55:53,043 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/875c3705f48c40bdab9a928f4cb9f27f 2023-10-29 23:55:53,433 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/e563974bdc9b49c89f65fed00c7163d4 2023-10-29 23:55:53,472 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029e9ef4f65b67d4477a78d52de2373f37a to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029e9ef4f65b67d4477a78d52de2373f37a 2023-10-29 23:55:53,481 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029ac848825bc4641ac93991025211bf88e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231029ac848825bc4641ac93991025211bf88e 2023-10-29 23:55:53,870 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310291580573faefe405a9d8f92de64b7c4ee to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310291580573faefe405a9d8f92de64b7c4ee 2023-10-29 23:55:53,875 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/828576783c9c47e9a28b4450775c2966 2023-10-29 23:55:53,876 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/6499b3e9b1cd4ee2bb276be9704674e2 2023-10-29 23:55:53,879 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/e563974bdc9b49c89f65fed00c7163d4 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/e563974bdc9b49c89f65fed00c7163d4 2023-10-29 23:55:53,880 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/a7cb41b5bbc64d1bbc1a040c457f1482 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/a7cb41b5bbc64d1bbc1a040c457f1482 2023-10-29 23:55:53,885 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/51cd5e7667d54e3891705bbf70372ffc 2023-10-29 23:55:53,890 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/875c3705f48c40bdab9a928f4cb9f27f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/875c3705f48c40bdab9a928f4cb9f27f 2023-10-29 23:55:53,904 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/e563974bdc9b49c89f65fed00c7163d4, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 23:55:53,904 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/828576783c9c47e9a28b4450775c2966 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/828576783c9c47e9a28b4450775c2966 2023-10-29 23:55:53,907 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/828576783c9c47e9a28b4450775c2966, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:53,908 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 264d801565ac50ccab63a80bae8e2378 in 1332ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:53,908 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:53,908 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:53,908 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:53,915 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/a7cb41b5bbc64d1bbc1a040c457f1482, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 23:55:53,916 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/6499b3e9b1cd4ee2bb276be9704674e2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/6499b3e9b1cd4ee2bb276be9704674e2 2023-10-29 23:55:53,919 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/6499b3e9b1cd4ee2bb276be9704674e2, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:53,920 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e03872693a60a2886e33b94dc392f86d in 1347ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:53,920 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:53,920 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:53,920 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:53,923 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/875c3705f48c40bdab9a928f4cb9f27f, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 23:55:53,923 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/51cd5e7667d54e3891705bbf70372ffc as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/51cd5e7667d54e3891705bbf70372ffc 2023-10-29 23:55:53,927 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/51cd5e7667d54e3891705bbf70372ffc, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 23:55:53,928 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3247d44a56444f401fcc527a3b3c98d9 in 1352ms, sequenceid=13, compaction requested=true 2023-10-29 23:55:53,928 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:55:53,928 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 23:55:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 23:55:53,930 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,930 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:53,930 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,930 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:53,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:53,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:53,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 23:55:53,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44633dbb[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:53,931 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 23:55:53,931 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,933 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,933 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 23:55:53,934 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 23:55:53,934 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:53,934 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,934 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 23:55:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:53,935 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 23:55:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:53,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:53,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:53,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 23:55:53,937 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 23:55:53,937 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:53,937 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:53,937 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 23:55:53,937 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:53,940 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:53,940 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:53,940 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:53,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:53,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:53,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:53,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:53,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:53,940 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:53,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:53,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:53,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:53,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:53,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:53,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:53,942 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:53,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:53,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:53,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:53,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 23:55:53,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:53,944 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:53,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:53,944 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:53,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:53,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:54,045 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:54,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:54,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:54,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:54,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 23:55:54,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:54,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:54,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 23:55:54,051 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 23:55:54,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:54,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 23:55:54,051 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 23:55:54,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,052 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,057 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:54,057 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:54,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:54,058 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,058 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:54,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:54,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,058 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 23:55:54,059 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 23:55:54,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 23:55:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 23:55:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:54,059 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 23:55:54,059 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:54,059 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. started... 2023-10-29 23:55:54,059 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:54,059 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. started... 2023-10-29 23:55:54,059 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e03872693a60a2886e33b94dc392f86d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:54,059 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 264d801565ac50ccab63a80bae8e2378 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:54,060 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:54,060 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:54,060 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. started... 2023-10-29 23:55:54,060 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3247d44a56444f401fcc527a3b3c98d9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 23:55:54,110 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029054b1aeef2b6455c801a124b0de6e5c7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029054b1aeef2b6455c801a124b0de6e5c7 2023-10-29 23:55:54,117 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102978b191bc857845d4b33b51180f977396 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023102978b191bc857845d4b33b51180f977396 2023-10-29 23:55:54,121 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029df311b84f48b4b1c89641d38e547dc29 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029df311b84f48b4b1c89641d38e547dc29 2023-10-29 23:55:54,126 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/7e7571e847274cda95677e0371dc3f7c 2023-10-29 23:55:54,136 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/8343964038ac4ca694808fe151469b0f 2023-10-29 23:55:54,137 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/879a7569807141158406f9493d6e09a2 2023-10-29 23:55:54,159 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310297585a92300dc49daaa9e557c1f4c6914 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310297585a92300dc49daaa9e557c1f4c6914 2023-10-29 23:55:54,170 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/d2059e18990846c6a4cdbe9f2b33bb3d 2023-10-29 23:55:54,174 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/7e7571e847274cda95677e0371dc3f7c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/7e7571e847274cda95677e0371dc3f7c 2023-10-29 23:55:54,175 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310295e73a2e3fb014ef982e947ec233dcbd3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202310295e73a2e3fb014ef982e947ec233dcbd3 2023-10-29 23:55:54,175 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029789525bd62d142fca9809b530dc8fdb6 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231029789525bd62d142fca9809b530dc8fdb6 2023-10-29 23:55:54,189 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/9bfde98e77eb4af5aa95d04eb4569078 2023-10-29 23:55:54,192 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/879a7569807141158406f9493d6e09a2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/879a7569807141158406f9493d6e09a2 2023-10-29 23:55:54,207 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/7e7571e847274cda95677e0371dc3f7c, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 23:55:54,208 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/d2059e18990846c6a4cdbe9f2b33bb3d as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d2059e18990846c6a4cdbe9f2b33bb3d 2023-10-29 23:55:54,211 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d2059e18990846c6a4cdbe9f2b33bb3d, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:54,212 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 264d801565ac50ccab63a80bae8e2378 in 153ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:54,212 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:54,212 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:54,212 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:54,215 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/879a7569807141158406f9493d6e09a2, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 23:55:54,215 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/9bfde98e77eb4af5aa95d04eb4569078 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/9bfde98e77eb4af5aa95d04eb4569078 2023-10-29 23:55:54,219 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/9bfde98e77eb4af5aa95d04eb4569078, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:54,220 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3247d44a56444f401fcc527a3b3c98d9 in 160ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:54,220 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:55:54,220 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:54,220 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:54,581 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 23:55:54,584 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/0fd445aa598b4bc09464d0d5d0467c0d 2023-10-29 23:55:54,589 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/8343964038ac4ca694808fe151469b0f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/8343964038ac4ca694808fe151469b0f 2023-10-29 23:55:54,616 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/8343964038ac4ca694808fe151469b0f, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 23:55:54,617 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/0fd445aa598b4bc09464d0d5d0467c0d as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/0fd445aa598b4bc09464d0d5d0467c0d 2023-10-29 23:55:54,622 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/0fd445aa598b4bc09464d0d5d0467c0d, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 23:55:54,623 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e03872693a60a2886e33b94dc392f86d in 564ms, sequenceid=17, compaction requested=true 2023-10-29 23:55:54,623 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:54,623 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:54,623 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:54,623 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:54,623 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 23:55:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 23:55:54,625 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,625 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:54,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 23:55:54,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18b588e3[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:54,628 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 23:55:54,628 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,629 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,629 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 23:55:54,629 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 23:55:54,629 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:54,629 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,629 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:54,630 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 23:55:54,630 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,630 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:54,630 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 23:55:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:54,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 23:55:54,633 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 23:55:54,633 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:54,633 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:54,633 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 23:55:54,633 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:54,637 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,637 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,637 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:54,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:54,638 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,639 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:54,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,641 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,641 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:54,641 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,641 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:54,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 23:55:54,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:54,641 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:54,641 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:54,641 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,642 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:54,642 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:54,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:54,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:54,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:54,642 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,742 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:54,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:54,750 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:54,756 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:54,764 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:55:54,765 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:55:54,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-29 23:55:54,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 23:55:54,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 23:55:54,866 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 23:55:54,866 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:54,866 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 23:55:54,866 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 23:55:54,866 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,866 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,867 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:54,867 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:54,868 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:54,868 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 23:55:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 23:55:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:54,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 23:55:54,869 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 23:55:54,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 23:55:54,869 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 23:55:54,869 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 23:55:54,869 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 23:55:54,869 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:54,869 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:54,869 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 23:55:54,869 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 23:55:54,869 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. started... 2023-10-29 23:55:54,869 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. started... 2023-10-29 23:55:54,869 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:54,869 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 264d801565ac50ccab63a80bae8e2378 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:54,869 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e03872693a60a2886e33b94dc392f86d 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:54,869 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. started... 2023-10-29 23:55:54,870 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3247d44a56444f401fcc527a3b3c98d9 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 23:55:54,906 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/8992b58374634b72b10bcd57e43e7ed0 2023-10-29 23:55:54,929 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8992b58374634b72b10bcd57e43e7ed0 2023-10-29 23:55:55,314 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/ab77a0a469d04bdca6ee541bc3255af2 2023-10-29 23:55:55,336 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab77a0a469d04bdca6ee541bc3255af2 2023-10-29 23:55:55,708 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/ee55cf00d0d44b9c99698193736d1795 2023-10-29 23:55:55,743 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/17ae7f330b324c5d85e48af02bdfe22c 2023-10-29 23:55:55,745 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee55cf00d0d44b9c99698193736d1795 2023-10-29 23:55:55,746 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17ae7f330b324c5d85e48af02bdfe22c 2023-10-29 23:55:55,747 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/8992b58374634b72b10bcd57e43e7ed0 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/8992b58374634b72b10bcd57e43e7ed0 2023-10-29 23:55:55,772 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8992b58374634b72b10bcd57e43e7ed0 2023-10-29 23:55:55,772 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/8992b58374634b72b10bcd57e43e7ed0, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 23:55:55,772 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/17ae7f330b324c5d85e48af02bdfe22c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/17ae7f330b324c5d85e48af02bdfe22c 2023-10-29 23:55:55,775 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17ae7f330b324c5d85e48af02bdfe22c 2023-10-29 23:55:55,775 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/17ae7f330b324c5d85e48af02bdfe22c, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:55,776 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3247d44a56444f401fcc527a3b3c98d9 in 906ms, sequenceid=23, compaction requested=true 2023-10-29 23:55:55,776 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:55:55,776 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 23:55:56,151 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/c7f62acb525c4e3bb73a0e2757ea5c06 2023-10-29 23:55:56,154 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7f62acb525c4e3bb73a0e2757ea5c06 2023-10-29 23:55:56,155 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/ab77a0a469d04bdca6ee541bc3255af2 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/ab77a0a469d04bdca6ee541bc3255af2 2023-10-29 23:55:56,179 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab77a0a469d04bdca6ee541bc3255af2 2023-10-29 23:55:56,179 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/ab77a0a469d04bdca6ee541bc3255af2, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 23:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/c7f62acb525c4e3bb73a0e2757ea5c06 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/c7f62acb525c4e3bb73a0e2757ea5c06 2023-10-29 23:55:56,183 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7f62acb525c4e3bb73a0e2757ea5c06 2023-10-29 23:55:56,183 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/c7f62acb525c4e3bb73a0e2757ea5c06, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:56,184 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e03872693a60a2886e33b94dc392f86d in 1315ms, sequenceid=23, compaction requested=true 2023-10-29 23:55:56,184 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:56,184 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 23:55:56,564 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/d25f54c76f714e42b02c6113886a4804 2023-10-29 23:55:56,568 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d25f54c76f714e42b02c6113886a4804 2023-10-29 23:55:56,568 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/ee55cf00d0d44b9c99698193736d1795 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/ee55cf00d0d44b9c99698193736d1795 2023-10-29 23:55:56,590 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee55cf00d0d44b9c99698193736d1795 2023-10-29 23:55:56,590 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/ee55cf00d0d44b9c99698193736d1795, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 23:55:56,591 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/d25f54c76f714e42b02c6113886a4804 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d25f54c76f714e42b02c6113886a4804 2023-10-29 23:55:56,594 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d25f54c76f714e42b02c6113886a4804 2023-10-29 23:55:56,595 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d25f54c76f714e42b02c6113886a4804, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 23:55:56,595 INFO [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 264d801565ac50ccab63a80bae8e2378 in 1726ms, sequenceid=23, compaction requested=true 2023-10-29 23:55:56,595 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:56,595 DEBUG [rs(jenkins-hbase4.apache.org,40533,1698623599827)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:56,595 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 23:55:56,595 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 23:55:56,596 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,596 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 23:55:56,596 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 23:55:56,597 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,597 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:56,598 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,598 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 23:55:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:56,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40533,1698623599827' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 23:55:56,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@478a5c04[Count = 0] remaining members to acquire global barrier 2023-10-29 23:55:56,599 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 23:55:56,599 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,602 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 23:55:56,602 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,602 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 23:55:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 23:55:56,602 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40533,1698623599827' in zk 2023-10-29 23:55:56,603 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 23:55:56,603 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:56,604 DEBUG [member: 'jenkins-hbase4.apache.org,40533,1698623599827' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 23:55:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40533,1698623599827': 2023-10-29 23:55:56,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40533,1698623599827' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 23:55:56,606 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 23:55:56,606 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 23:55:56,606 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 23:55:56,606 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 23:55:56,606 INFO [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 23:55:56,608 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:56,608 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:56,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 23:55:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 23:55:56,608 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 23:55:56,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:56,609 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 23:55:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,610 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 23:55:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 23:55:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:56,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 23:55:56,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 23:55:56,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 23:55:56,612 DEBUG [(jenkins-hbase4.apache.org,45019,1698623598662)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:55:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 23:55:56,612 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 23:55:56,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 23:55:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 23:55:56,613 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 23:55:56,713 DEBUG [Listener at localhost/45261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 23:55:56,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 23:55:56,714 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:56,714 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): e03872693a60a2886e33b94dc392f86d/family1 is initiating major compaction (all files) 2023-10-29 23:55:56,714 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:56,714 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:56,714 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of e03872693a60a2886e33b94dc392f86d/family1 in testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:56,714 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/6a728354d3dd43c487af25187b18d24c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/7079bc72f1ef464f8f39dd9f5fa45208, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/a7cb41b5bbc64d1bbc1a040c457f1482, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/8343964038ac4ca694808fe151469b0f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/ab77a0a469d04bdca6ee541bc3255af2] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp, totalSize=27.1 K 2023-10-29 23:55:56,715 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 6a728354d3dd43c487af25187b18d24c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623750009 2023-10-29 23:55:56,715 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 7079bc72f1ef464f8f39dd9f5fa45208, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623751080 2023-10-29 23:55:56,716 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting a7cb41b5bbc64d1bbc1a040c457f1482, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623752564 2023-10-29 23:55:56,716 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 8343964038ac4ca694808fe151469b0f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623754046 2023-10-29 23:55:56,716 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting ab77a0a469d04bdca6ee541bc3255af2, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:56,725 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): e03872693a60a2886e33b94dc392f86d#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:57,162 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023102937585cd0d85247009b63c837d8163b18_del 2023-10-29 23:55:57,162 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102937585cd0d85247009b63c837d8163b18_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023102937585cd0d85247009b63c837d8163b18_del 2023-10-29 23:55:57,614 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 453d3b6a6bda4030ae118f4230d9af52 2023-10-29 23:55:57,614 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family1/453d3b6a6bda4030ae118f4230d9af52 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/453d3b6a6bda4030ae118f4230d9af52 2023-10-29 23:55:57,636 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 453d3b6a6bda4030ae118f4230d9af52 2023-10-29 23:55:57,637 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e03872693a60a2886e33b94dc392f86d/family1 of e03872693a60a2886e33b94dc392f86d into 453d3b6a6bda4030ae118f4230d9af52(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:57,637 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:57,637 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:57,637 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): e03872693a60a2886e33b94dc392f86d/family2 is initiating major compaction (all files) 2023-10-29 23:55:57,637 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:57,637 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:57,639 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of e03872693a60a2886e33b94dc392f86d/family2 in testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:55:57,639 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/b1dc3c992fb643b785b69e4314383bb9, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/4421e14722ef4c74b9b361dab8cfc3ce, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/6499b3e9b1cd4ee2bb276be9704674e2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/0fd445aa598b4bc09464d0d5d0467c0d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/c7f62acb525c4e3bb73a0e2757ea5c06] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp, totalSize=25.4 K 2023-10-29 23:55:57,640 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting b1dc3c992fb643b785b69e4314383bb9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623750009 2023-10-29 23:55:57,640 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 4421e14722ef4c74b9b361dab8cfc3ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623751080 2023-10-29 23:55:57,640 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 6499b3e9b1cd4ee2bb276be9704674e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623752564 2023-10-29 23:55:57,641 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 0fd445aa598b4bc09464d0d5d0467c0d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623754046 2023-10-29 23:55:57,641 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting c7f62acb525c4e3bb73a0e2757ea5c06, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:57,648 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): e03872693a60a2886e33b94dc392f86d#family2#compaction#198 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:57,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/6a728354d3dd43c487af25187b18d24c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/7079bc72f1ef464f8f39dd9f5fa45208, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/a7cb41b5bbc64d1bbc1a040c457f1482, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/8343964038ac4ca694808fe151469b0f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/ab77a0a469d04bdca6ee541bc3255af2] to archive 2023-10-29 23:55:57,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:57,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/6a728354d3dd43c487af25187b18d24c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/6a728354d3dd43c487af25187b18d24c 2023-10-29 23:55:57,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/7079bc72f1ef464f8f39dd9f5fa45208 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/7079bc72f1ef464f8f39dd9f5fa45208 2023-10-29 23:55:57,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/a7cb41b5bbc64d1bbc1a040c457f1482 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/a7cb41b5bbc64d1bbc1a040c457f1482 2023-10-29 23:55:57,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/8343964038ac4ca694808fe151469b0f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/8343964038ac4ca694808fe151469b0f 2023-10-29 23:55:57,711 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/ab77a0a469d04bdca6ee541bc3255af2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/ab77a0a469d04bdca6ee541bc3255af2 2023-10-29 23:55:58,056 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029af44bcfc8fb541fd9aff40cf2c95c469_del 2023-10-29 23:55:58,057 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029af44bcfc8fb541fd9aff40cf2c95c469_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029af44bcfc8fb541fd9aff40cf2c95c469_del 2023-10-29 23:55:58,468 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1514cac7bc43407dac54e07a86b10aba 2023-10-29 23:55:58,468 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/.tmp/family2/1514cac7bc43407dac54e07a86b10aba as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/1514cac7bc43407dac54e07a86b10aba 2023-10-29 23:55:58,471 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1514cac7bc43407dac54e07a86b10aba 2023-10-29 23:55:58,472 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e03872693a60a2886e33b94dc392f86d/family2 of e03872693a60a2886e33b94dc392f86d into 1514cac7bc43407dac54e07a86b10aba(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:58,472 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:55:58,473 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:58,473 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 264d801565ac50ccab63a80bae8e2378/family1 is initiating major compaction (all files) 2023-10-29 23:55:58,473 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:58,473 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:58,474 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 264d801565ac50ccab63a80bae8e2378/family1 in testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:58,474 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/022f936e52c04880a80a242647b27c53, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/51d81e26809c4f8a82def5caa1c05318, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/e563974bdc9b49c89f65fed00c7163d4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/7e7571e847274cda95677e0371dc3f7c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/ee55cf00d0d44b9c99698193736d1795] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp, totalSize=27.1 K 2023-10-29 23:55:58,475 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 022f936e52c04880a80a242647b27c53, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623750009 2023-10-29 23:55:58,475 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 51d81e26809c4f8a82def5caa1c05318, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623751080 2023-10-29 23:55:58,475 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting e563974bdc9b49c89f65fed00c7163d4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623752565 2023-10-29 23:55:58,475 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 7e7571e847274cda95677e0371dc3f7c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623754047 2023-10-29 23:55:58,476 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting ee55cf00d0d44b9c99698193736d1795, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:58,483 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 264d801565ac50ccab63a80bae8e2378#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:58,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/b1dc3c992fb643b785b69e4314383bb9, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/4421e14722ef4c74b9b361dab8cfc3ce, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/6499b3e9b1cd4ee2bb276be9704674e2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/0fd445aa598b4bc09464d0d5d0467c0d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/c7f62acb525c4e3bb73a0e2757ea5c06] to archive 2023-10-29 23:55:58,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:58,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/b1dc3c992fb643b785b69e4314383bb9 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/b1dc3c992fb643b785b69e4314383bb9 2023-10-29 23:55:58,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/4421e14722ef4c74b9b361dab8cfc3ce to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/4421e14722ef4c74b9b361dab8cfc3ce 2023-10-29 23:55:58,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/6499b3e9b1cd4ee2bb276be9704674e2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/6499b3e9b1cd4ee2bb276be9704674e2 2023-10-29 23:55:58,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/0fd445aa598b4bc09464d0d5d0467c0d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/0fd445aa598b4bc09464d0d5d0467c0d 2023-10-29 23:55:58,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/c7f62acb525c4e3bb73a0e2757ea5c06 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family2/c7f62acb525c4e3bb73a0e2757ea5c06 2023-10-29 23:55:58,921 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029ea82a4736a834a29aaa0f37e74aea2dd_del 2023-10-29 23:55:58,921 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029ea82a4736a834a29aaa0f37e74aea2dd_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029ea82a4736a834a29aaa0f37e74aea2dd_del 2023-10-29 23:55:58,986 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:55:58,986 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12220ede to 127.0.0.1:50259 2023-10-29 23:55:58,986 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:55:58,987 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 213a3a49100041bf92994f447eb50c7f 2023-10-29 23:55:58,988 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family1/213a3a49100041bf92994f447eb50c7f as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/213a3a49100041bf92994f447eb50c7f 2023-10-29 23:55:59,010 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 213a3a49100041bf92994f447eb50c7f 2023-10-29 23:55:59,011 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 264d801565ac50ccab63a80bae8e2378/family1 of 264d801565ac50ccab63a80bae8e2378 into 213a3a49100041bf92994f447eb50c7f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:59,011 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:59,011 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:59,011 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 264d801565ac50ccab63a80bae8e2378/family2 is initiating major compaction (all files) 2023-10-29 23:55:59,011 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:59,011 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:59,012 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 264d801565ac50ccab63a80bae8e2378/family2 in testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:55:59,012 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/7853ddc08a664c908db9cea33cda1206, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/de8f7ff0130e47629922c7b2b34750b3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/828576783c9c47e9a28b4450775c2966, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d2059e18990846c6a4cdbe9f2b33bb3d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d25f54c76f714e42b02c6113886a4804] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp, totalSize=25.4 K 2023-10-29 23:55:59,012 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 7853ddc08a664c908db9cea33cda1206, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623750009 2023-10-29 23:55:59,013 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting de8f7ff0130e47629922c7b2b34750b3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623751080 2023-10-29 23:55:59,013 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 828576783c9c47e9a28b4450775c2966, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623752565 2023-10-29 23:55:59,013 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting d2059e18990846c6a4cdbe9f2b33bb3d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623754047 2023-10-29 23:55:59,014 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting d25f54c76f714e42b02c6113886a4804, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:59,021 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 264d801565ac50ccab63a80bae8e2378#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:59,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/022f936e52c04880a80a242647b27c53, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/51d81e26809c4f8a82def5caa1c05318, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/e563974bdc9b49c89f65fed00c7163d4, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/7e7571e847274cda95677e0371dc3f7c, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/ee55cf00d0d44b9c99698193736d1795] to archive 2023-10-29 23:55:59,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:59,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/022f936e52c04880a80a242647b27c53 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/022f936e52c04880a80a242647b27c53 2023-10-29 23:55:59,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/51d81e26809c4f8a82def5caa1c05318 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/51d81e26809c4f8a82def5caa1c05318 2023-10-29 23:55:59,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/e563974bdc9b49c89f65fed00c7163d4 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/e563974bdc9b49c89f65fed00c7163d4 2023-10-29 23:55:59,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/7e7571e847274cda95677e0371dc3f7c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/7e7571e847274cda95677e0371dc3f7c 2023-10-29 23:55:59,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/ee55cf00d0d44b9c99698193736d1795 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/ee55cf00d0d44b9c99698193736d1795 2023-10-29 23:55:59,427 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023102977aa3e7ea6fc4767bf2eca437030cd35_del 2023-10-29 23:55:59,428 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102977aa3e7ea6fc4767bf2eca437030cd35_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023102977aa3e7ea6fc4767bf2eca437030cd35_del 2023-10-29 23:55:59,840 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d327f0e06704db585943dffef54cdfa 2023-10-29 23:55:59,841 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/.tmp/family2/8d327f0e06704db585943dffef54cdfa as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/8d327f0e06704db585943dffef54cdfa 2023-10-29 23:55:59,845 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d327f0e06704db585943dffef54cdfa 2023-10-29 23:55:59,846 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 264d801565ac50ccab63a80bae8e2378/family2 of 264d801565ac50ccab63a80bae8e2378 into 8d327f0e06704db585943dffef54cdfa(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:55:59,846 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:55:59,846 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:55:59,846 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 3247d44a56444f401fcc527a3b3c98d9/family1 is initiating major compaction (all files) 2023-10-29 23:55:59,846 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:55:59,846 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:55:59,847 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 3247d44a56444f401fcc527a3b3c98d9/family1 in testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:55:59,847 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/4407e147c5a84755a0732c14fbd2ddb8, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/9794d6c50d0540d48320e649a43de9d1, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/875c3705f48c40bdab9a928f4cb9f27f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/879a7569807141158406f9493d6e09a2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/8992b58374634b72b10bcd57e43e7ed0] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp, totalSize=27.1 K 2023-10-29 23:55:59,848 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 4407e147c5a84755a0732c14fbd2ddb8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623750010 2023-10-29 23:55:59,848 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 9794d6c50d0540d48320e649a43de9d1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623751080 2023-10-29 23:55:59,848 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 875c3705f48c40bdab9a928f4cb9f27f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623752565 2023-10-29 23:55:59,849 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 879a7569807141158406f9493d6e09a2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623754047 2023-10-29 23:55:59,849 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 8992b58374634b72b10bcd57e43e7ed0, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:55:59,857 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 3247d44a56444f401fcc527a3b3c98d9#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:55:59,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/7853ddc08a664c908db9cea33cda1206, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/de8f7ff0130e47629922c7b2b34750b3, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/828576783c9c47e9a28b4450775c2966, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d2059e18990846c6a4cdbe9f2b33bb3d, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d25f54c76f714e42b02c6113886a4804] to archive 2023-10-29 23:55:59,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:55:59,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/7853ddc08a664c908db9cea33cda1206 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/7853ddc08a664c908db9cea33cda1206 2023-10-29 23:55:59,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/de8f7ff0130e47629922c7b2b34750b3 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/de8f7ff0130e47629922c7b2b34750b3 2023-10-29 23:55:59,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/828576783c9c47e9a28b4450775c2966 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/828576783c9c47e9a28b4450775c2966 2023-10-29 23:55:59,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d2059e18990846c6a4cdbe9f2b33bb3d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d2059e18990846c6a4cdbe9f2b33bb3d 2023-10-29 23:55:59,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d25f54c76f714e42b02c6113886a4804 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family2/d25f54c76f714e42b02c6113886a4804 2023-10-29 23:56:00,297 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029c80823331b3e4beb89d979d56a4f57ae_del 2023-10-29 23:56:00,297 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029c80823331b3e4beb89d979d56a4f57ae_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029c80823331b3e4beb89d979d56a4f57ae_del 2023-10-29 23:56:00,749 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fece80ffc4c44ac6b731232f1ee4d4dc 2023-10-29 23:56:00,750 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family1/fece80ffc4c44ac6b731232f1ee4d4dc as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/fece80ffc4c44ac6b731232f1ee4d4dc 2023-10-29 23:56:00,772 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fece80ffc4c44ac6b731232f1ee4d4dc 2023-10-29 23:56:00,773 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3247d44a56444f401fcc527a3b3c98d9/family1 of 3247d44a56444f401fcc527a3b3c98d9 into fece80ffc4c44ac6b731232f1ee4d4dc(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 23:56:00,773 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:56:00,773 DEBUG [Listener at localhost/45261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 23:56:00,773 DEBUG [Listener at localhost/45261] regionserver.HStore(1912): 3247d44a56444f401fcc527a3b3c98d9/family2 is initiating major compaction (all files) 2023-10-29 23:56:00,773 INFO [Listener at localhost/45261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 23:56:00,773 INFO [Listener at localhost/45261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 23:56:00,773 INFO [Listener at localhost/45261] regionserver.HRegion(2259): Starting compaction of 3247d44a56444f401fcc527a3b3c98d9/family2 in testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:56:00,774 INFO [Listener at localhost/45261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/f9200c95d07149309e2bc50204909d14, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/3da6c412377745609cbe971f775b287e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/51cd5e7667d54e3891705bbf70372ffc, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/9bfde98e77eb4af5aa95d04eb4569078, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/17ae7f330b324c5d85e48af02bdfe22c] into tmpdir=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp, totalSize=25.4 K 2023-10-29 23:56:00,774 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting f9200c95d07149309e2bc50204909d14, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698623750010 2023-10-29 23:56:00,774 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 3da6c412377745609cbe971f775b287e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698623751080 2023-10-29 23:56:00,775 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 51cd5e7667d54e3891705bbf70372ffc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698623752565 2023-10-29 23:56:00,775 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 9bfde98e77eb4af5aa95d04eb4569078, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698623754047 2023-10-29 23:56:00,775 DEBUG [Listener at localhost/45261] compactions.Compactor(207): Compacting 17ae7f330b324c5d85e48af02bdfe22c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 23:56:00,783 INFO [Listener at localhost/45261] throttle.PressureAwareThroughputController(145): 3247d44a56444f401fcc527a3b3c98d9#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 23:56:00,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/4407e147c5a84755a0732c14fbd2ddb8, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/9794d6c50d0540d48320e649a43de9d1, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/875c3705f48c40bdab9a928f4cb9f27f, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/879a7569807141158406f9493d6e09a2, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/8992b58374634b72b10bcd57e43e7ed0] to archive 2023-10-29 23:56:00,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:00,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/4407e147c5a84755a0732c14fbd2ddb8 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/4407e147c5a84755a0732c14fbd2ddb8 2023-10-29 23:56:00,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/9794d6c50d0540d48320e649a43de9d1 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/9794d6c50d0540d48320e649a43de9d1 2023-10-29 23:56:00,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/875c3705f48c40bdab9a928f4cb9f27f to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/875c3705f48c40bdab9a928f4cb9f27f 2023-10-29 23:56:00,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/879a7569807141158406f9493d6e09a2 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/879a7569807141158406f9493d6e09a2 2023-10-29 23:56:00,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/8992b58374634b72b10bcd57e43e7ed0 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/8992b58374634b72b10bcd57e43e7ed0 2023-10-29 23:56:01,190 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029b4c0443e28db43999577af727cdc8e5b_del 2023-10-29 23:56:01,190 INFO [Listener at localhost/45261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b4c0443e28db43999577af727cdc8e5b_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231029b4c0443e28db43999577af727cdc8e5b_del 2023-10-29 23:56:02,003 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06b7571139f84ecca0568632e2c1762c 2023-10-29 23:56:02,004 DEBUG [Listener at localhost/45261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/.tmp/family2/06b7571139f84ecca0568632e2c1762c as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/06b7571139f84ecca0568632e2c1762c 2023-10-29 23:56:02,008 INFO [Listener at localhost/45261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06b7571139f84ecca0568632e2c1762c 2023-10-29 23:56:02,009 INFO [Listener at localhost/45261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3247d44a56444f401fcc527a3b3c98d9/family2 of 3247d44a56444f401fcc527a3b3c98d9 into 06b7571139f84ecca0568632e2c1762c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 23:56:02,009 DEBUG [Listener at localhost/45261] regionserver.HRegion(2289): Compaction status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:56:02,012 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:56:02,015 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:56:02,018 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:56:02,019 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:56:02,024 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45019] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC2`Y,H]4=\x1B\xA28\xF2b6\x01\xC0"\x10\x12\x9C#4\xF2\xEC\x9D"_\xAA*\xDE\x12\xF5)\xD9*\x10\x04\xEEZ^\xDCkq.\xC4\xA8d\x8F\xC9\xA3\x10\xA42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-10-29 23:56:02,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 23:56:02,045 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 23:56:02,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:56:02,045 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698624362045 2023-10-29 23:56:02,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 23:56:02,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/f9200c95d07149309e2bc50204909d14, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/3da6c412377745609cbe971f775b287e, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/51cd5e7667d54e3891705bbf70372ffc, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/9bfde98e77eb4af5aa95d04eb4569078, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/17ae7f330b324c5d85e48af02bdfe22c] to archive 2023-10-29 23:56:02,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:02,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/f9200c95d07149309e2bc50204909d14 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/f9200c95d07149309e2bc50204909d14 2023-10-29 23:56:02,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/3da6c412377745609cbe971f775b287e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/3da6c412377745609cbe971f775b287e 2023-10-29 23:56:02,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/51cd5e7667d54e3891705bbf70372ffc to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/51cd5e7667d54e3891705bbf70372ffc 2023-10-29 23:56:02,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/9bfde98e77eb4af5aa95d04eb4569078 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/9bfde98e77eb4af5aa95d04eb4569078 2023-10-29 23:56:02,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/17ae7f330b324c5d85e48af02bdfe22c to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family2/17ae7f330b324c5d85e48af02bdfe22c 2023-10-29 23:56:02,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-10-29 23:56:02,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023102937585cd0d85247009b63c837d8163b18_del 2023-10-29 23:56:02,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029ea82a4736a834a29aaa0f37e74aea2dd_del 2023-10-29 23:56:02,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029c80823331b3e4beb89d979d56a4f57ae_del 2023-10-29 23:56:02,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:02,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] zookeeper.ReadOnlyZKClient(139): Connect 0x337c8457 to 127.0.0.1:50259 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 23:56:02,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b30c9df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 23:56:02,455 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 23:56:03,401 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029bc7cc02e75424ac0945f0661f6384399 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029bc7cc02e75424ac0945f0661f6384399 2023-10-29 23:56:03,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:03,412 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 23:56:03,415 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 23:56:03,422 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 23:56:03,424 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 23:56:03,455 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/e37712a232314e39a182b382ce4b0882 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-29 23:56:03,455 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/e37712a232314e39a182b382ce4b0882}] 2023-10-29 23:56:03,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/e37712a232314e39a182b382ce4b0882 for inclusion in e03872693a60a2886e33b94dc392f86d/family1 2023-10-29 23:56:03,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-29 23:56:03,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 23:56:03,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:56:03,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/e37712a232314e39a182b382ce4b0882 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__7stsl6ej9aej6rhndgnnqsljsurdvuobbfreh7qbtfaulfhqd4l6b4a55812g20b/family1/e37712a232314e39a182b382ce4b0882 2023-10-29 23:56:03,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__7stsl6ej9aej6rhndgnnqsljsurdvuobbfreh7qbtfaulfhqd4l6b4a55812g20b/family1/e37712a232314e39a182b382ce4b0882 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/47f456159acf48d18eb0ecfd5fac789b_SeqId_28_ 2023-10-29 23:56:03,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__7stsl6ej9aej6rhndgnnqsljsurdvuobbfreh7qbtfaulfhqd4l6b4a55812g20b/family1/e37712a232314e39a182b382ce4b0882 into e03872693a60a2886e33b94dc392f86d/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/47f456159acf48d18eb0ecfd5fac789b_SeqId_28_ - updating store file list. 2023-10-29 23:56:03,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/47f456159acf48d18eb0ecfd5fac789b_SeqId_28_ into e03872693a60a2886e33b94dc392f86d/family1 2023-10-29 23:56:03,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__7stsl6ej9aej6rhndgnnqsljsurdvuobbfreh7qbtfaulfhqd4l6b4a55812g20b/family1/e37712a232314e39a182b382ce4b0882 into e03872693a60a2886e33b94dc392f86d/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/family1/47f456159acf48d18eb0ecfd5fac789b_SeqId_28_) 2023-10-29 23:56:03,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__7stsl6ej9aej6rhndgnnqsljsurdvuobbfreh7qbtfaulfhqd4l6b4a55812g20b/family1/e37712a232314e39a182b382ce4b0882 2023-10-29 23:56:03,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:03,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:03,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310292993854034404994acca3798a6a8639e to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310292993854034404994acca3798a6a8639e 2023-10-29 23:56:03,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310296ab22123a6214c348fac1c1f87f63272 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310296ab22123a6214c348fac1c1f87f63272 2023-10-29 23:56:03,516 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023102978b191bc857845d4b33b51180f977396 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023102978b191bc857845d4b33b51180f977396 2023-10-29 23:56:03,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029d386bde8d6504e3398cda3824281e799 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029d386bde8d6504e3398cda3824281e799 2023-10-29 23:56:03,517 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 23:56:03,517 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 23:56:03,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 23:56:03,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 23:56:03,703 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310294109fe0183b045b68081cdb981982d6d to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310294109fe0183b045b68081cdb981982d6d 2023-10-29 23:56:03,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:03,748 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/bb289b78a833468ca494d8803e403e67 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-29 23:56:03,749 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/bb289b78a833468ca494d8803e403e67}] 2023-10-29 23:56:03,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/bb289b78a833468ca494d8803e403e67 for inclusion in 3247d44a56444f401fcc527a3b3c98d9/family1 2023-10-29 23:56:03,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-29 23:56:03,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 23:56:03,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:56:03,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/bb289b78a833468ca494d8803e403e67 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__3ru4430kbtd4r4jd4epp7r0se9vuvcr69t9m52j08jl17u8co3st7606jr993sq3/family1/bb289b78a833468ca494d8803e403e67 2023-10-29 23:56:03,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__3ru4430kbtd4r4jd4epp7r0se9vuvcr69t9m52j08jl17u8co3st7606jr993sq3/family1/bb289b78a833468ca494d8803e403e67 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/d45599ffc5a4467cb427e571ffceb23b_SeqId_28_ 2023-10-29 23:56:03,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__3ru4430kbtd4r4jd4epp7r0se9vuvcr69t9m52j08jl17u8co3st7606jr993sq3/family1/bb289b78a833468ca494d8803e403e67 into 3247d44a56444f401fcc527a3b3c98d9/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/d45599ffc5a4467cb427e571ffceb23b_SeqId_28_ - updating store file list. 2023-10-29 23:56:03,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/d45599ffc5a4467cb427e571ffceb23b_SeqId_28_ into 3247d44a56444f401fcc527a3b3c98d9/family1 2023-10-29 23:56:03,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__3ru4430kbtd4r4jd4epp7r0se9vuvcr69t9m52j08jl17u8co3st7606jr993sq3/family1/bb289b78a833468ca494d8803e403e67 into 3247d44a56444f401fcc527a3b3c98d9/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/family1/d45599ffc5a4467cb427e571ffceb23b_SeqId_28_) 2023-10-29 23:56:03,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__3ru4430kbtd4r4jd4epp7r0se9vuvcr69t9m52j08jl17u8co3st7606jr993sq3/family1/bb289b78a833468ca494d8803e403e67 2023-10-29 23:56:03,803 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:03,804 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:03,805 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310292d4e272c405b4a4d81dc022fbfd37245 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310292d4e272c405b4a4d81dc022fbfd37245 2023-10-29 23:56:03,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310292d697b0b6c9c4ab88e2698ac51fcee74 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310292d697b0b6c9c4ab88e2698ac51fcee74 2023-10-29 23:56:03,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310297a3c9bfa3ef74ddbbbf566c15d851097 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310297a3c9bfa3ef74ddbbbf566c15d851097 2023-10-29 23:56:03,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029df311b84f48b4b1c89641d38e547dc29 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029df311b84f48b4b1c89641d38e547dc29 2023-10-29 23:56:03,808 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 23:56:03,808 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 23:56:03,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 23:56:03,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 23:56:03,977 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029dc363bfd5b3742f494e42ab666e36429 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029dc363bfd5b3742f494e42ab666e36429 2023-10-29 23:56:03,978 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:04,016 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e17355ff38bb49ddba1ce1d0e4b4f181 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-29 23:56:04,017 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378., hostname=jenkins-hbase4.apache.org,40533,1698623599827, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e17355ff38bb49ddba1ce1d0e4b4f181}] 2023-10-29 23:56:04,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(763): Validating hfile at hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e17355ff38bb49ddba1ce1d0e4b4f181 for inclusion in 264d801565ac50ccab63a80bae8e2378/family1 2023-10-29 23:56:04,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-29 23:56:04,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 23:56:04,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegion(2446): Flush status journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:56:04,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e17355ff38bb49ddba1ce1d0e4b4f181 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__dolpai8gpf0khgjhcs9dnuutgp5rdb9vde75qaofi1pmsfhpr9r7sepjmf6dgnoo/family1/e17355ff38bb49ddba1ce1d0e4b4f181 2023-10-29 23:56:04,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__dolpai8gpf0khgjhcs9dnuutgp5rdb9vde75qaofi1pmsfhpr9r7sepjmf6dgnoo/family1/e17355ff38bb49ddba1ce1d0e4b4f181 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/84e0c382e9ba4f6fac14d6b4b5d7844f_SeqId_28_ 2023-10-29 23:56:04,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(849): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__dolpai8gpf0khgjhcs9dnuutgp5rdb9vde75qaofi1pmsfhpr9r7sepjmf6dgnoo/family1/e17355ff38bb49ddba1ce1d0e4b4f181 into 264d801565ac50ccab63a80bae8e2378/family1 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/84e0c382e9ba4f6fac14d6b4b5d7844f_SeqId_28_ - updating store file list. 2023-10-29 23:56:04,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(882): Loaded HFile hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/84e0c382e9ba4f6fac14d6b4b5d7844f_SeqId_28_ into 264d801565ac50ccab63a80bae8e2378/family1 2023-10-29 23:56:04,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.HStore(855): Successfully loaded hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__dolpai8gpf0khgjhcs9dnuutgp5rdb9vde75qaofi1pmsfhpr9r7sepjmf6dgnoo/family1/e17355ff38bb49ddba1ce1d0e4b4f181 into 264d801565ac50ccab63a80bae8e2378/family1 (new location: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/family1/84e0c382e9ba4f6fac14d6b4b5d7844f_SeqId_28_) 2023-10-29 23:56:04,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40533] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/staging/jenkins__testMajorCompactionFromAdmin__dolpai8gpf0khgjhcs9dnuutgp5rdb9vde75qaofi1pmsfhpr9r7sepjmf6dgnoo/family1/e17355ff38bb49ddba1ce1d0e4b4f181 2023-10-29 23:56:04,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:04,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:04,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029054b1aeef2b6455c801a124b0de6e5c7 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029054b1aeef2b6455c801a124b0de6e5c7 2023-10-29 23:56:04,069 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293307004e540c4003a4f82d64dd4aa833 to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293307004e540c4003a4f82d64dd4aa833 2023-10-29 23:56:04,070 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029b003486814014f06adf9068c0c6e67ef to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029b003486814014f06adf9068c0c6e67ef 2023-10-29 23:56:04,071 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f11a5770c1cd4f3cbf9c7c4dc1bf720b to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f11a5770c1cd4f3cbf9c7c4dc1bf720b 2023-10-29 23:56:04,071 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 23:56:04,071 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 23:56:04,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 23:56:04,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 23:56:04,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 23:56:04,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023102937585cd0d85247009b63c837d8163b18_del] 2023-10-29 23:56:04,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:04,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023102937585cd0d85247009b63c837d8163b18_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023102937585cd0d85247009b63c837d8163b18_del 2023-10-29 23:56:04,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 23:56:04,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029ea82a4736a834a29aaa0f37e74aea2dd_del] 2023-10-29 23:56:04,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:04,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029ea82a4736a834a29aaa0f37e74aea2dd_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029ea82a4736a834a29aaa0f37e74aea2dd_del 2023-10-29 23:56:04,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 23:56:04,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029c80823331b3e4beb89d979d56a4f57ae_del] 2023-10-29 23:56:04,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 23:56:04,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029c80823331b3e4beb89d979d56a4f57ae_del to hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029c80823331b3e4beb89d979d56a4f57ae_del 2023-10-29 23:56:04,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 23:56:04,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698623603302] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 23:56:04,078 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 23:56:04,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.0350 sec 2023-10-29 23:56:04,093 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:56:04,095 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:56:04,097 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 23:56:04,098 DEBUG [Listener at localhost/45261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 23:56:04,101 INFO [Listener at localhost/45261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 23:56:04,136 INFO [Listener at localhost/45261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 262), OpenFileDescriptor=657 (was 652) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 174), ProcessCount=166 (was 166), AvailableMemoryMB=14492 (was 14496) 2023-10-29 23:56:04,136 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01f936d5 to 127.0.0.1:50259 2023-10-29 23:56:04,136 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:56:04,137 INFO [Listener at localhost/45261] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-29 23:56:04,137 INFO [Listener at localhost/45261] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 23:56:04,137 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ed7fc80 to 127.0.0.1:50259 2023-10-29 23:56:04,137 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:56:04,137 DEBUG [Listener at localhost/45261] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-29 23:56:04,137 DEBUG [Listener at localhost/45261] util.JVMClusterUtil(257): Found active master hash=849556492, stopped=false 2023-10-29 23:56:04,137 INFO [Listener at localhost/45261] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:56:04,139 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-29 23:56:04,140 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-29 23:56:04,140 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:56:04,140 INFO [Listener at localhost/45261] procedure2.ProcedureExecutor(628): Stopping 2023-10-29 23:56:04,140 DEBUG [Listener at localhost/45261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bf6af6b to 127.0.0.1:50259 2023-10-29 23:56:04,140 DEBUG [Listener at localhost/45261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:56:04,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 23:56:04,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 23:56:04,140 INFO [Listener at localhost/45261] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40533,1698623599827' ***** 2023-10-29 23:56:04,141 INFO [Listener at localhost/45261] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-29 23:56:04,141 INFO [RS:0;jenkins-hbase4:40533] regionserver.HeapMemoryManager(220): Stopping 2023-10-29 23:56:04,141 INFO [RS:0;jenkins-hbase4:40533] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-29 23:56:04,141 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-29 23:56:04,141 INFO [RS:0;jenkins-hbase4:40533] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-29 23:56:04,141 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for bb493c0b10ea913a02a3d41519407ba4 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for e03872693a60a2886e33b94dc392f86d 2023-10-29 23:56:04,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb493c0b10ea913a02a3d41519407ba4, disabling compactions & flushes 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 368df6736c0a028a52e8a16a42f4459b 2023-10-29 23:56:04,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 8062191887307ceea838f50b05ff311e 2023-10-29 23:56:04,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:56:04,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. after waiting 0 ms 2023-10-29 23:56:04,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for d5dabbd5b853e6e71a0d5e5a22a35e46 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for e3be6f486f3c65a567087911fc90d6e4 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for e64684f25940ad580cd493bca8b0ccb7 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 9503a9edc2e7fdcd40523a76a7ac98fc 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 264d801565ac50ccab63a80bae8e2378 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 9604a801c866eb60838685d5f64f7edf 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for bde89851cefe798361b48e9f1ef1975a 2023-10-29 23:56:04,142 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for dc879cf7ad8f38cb32285196def3085e 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 1103e88b929851b6544b2e0f1f56c505 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 6901f72bd24459da3e941a35fa0c1eb5 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for b5d4c06575fb129fc87f52ae6d1b5800 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 8cf1fecd38159dabaaf2730f99142bed 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 0c28470338353b99d9c310d1396c3e88 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 3247d44a56444f401fcc527a3b3c98d9 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for f4685077c709633cc85813f6672ca901 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 27ca3771a04def85215201203d9952c7 2023-10-29 23:56:04,143 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:56:04,143 DEBUG [RS:0;jenkins-hbase4:40533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f14fd09 to 127.0.0.1:50259 2023-10-29 23:56:04,143 DEBUG [RS:0;jenkins-hbase4:40533] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:56:04,144 INFO [RS:0;jenkins-hbase4:40533] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-29 23:56:04,144 INFO [RS:0;jenkins-hbase4:40533] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-29 23:56:04,144 INFO [RS:0;jenkins-hbase4:40533] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-29 23:56:04,144 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-29 23:56:04,144 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-10-29 23:56:04,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-29 23:56:04,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-29 23:56:04,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-29 23:56:04,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-29 23:56:04,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-29 23:56:04,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-10-29 23:56:04,145 DEBUG [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1504): Waiting on 0c28470338353b99d9c310d1396c3e88, 1103e88b929851b6544b2e0f1f56c505, 1588230740, 264d801565ac50ccab63a80bae8e2378, 27ca3771a04def85215201203d9952c7, 3247d44a56444f401fcc527a3b3c98d9, 368df6736c0a028a52e8a16a42f4459b, 6901f72bd24459da3e941a35fa0c1eb5, 8062191887307ceea838f50b05ff311e, 8cf1fecd38159dabaaf2730f99142bed, 9503a9edc2e7fdcd40523a76a7ac98fc, 9604a801c866eb60838685d5f64f7edf, b5d4c06575fb129fc87f52ae6d1b5800, bb493c0b10ea913a02a3d41519407ba4, bde89851cefe798361b48e9f1ef1975a, d5dabbd5b853e6e71a0d5e5a22a35e46, dc879cf7ad8f38cb32285196def3085e, e03872693a60a2886e33b94dc392f86d, e3be6f486f3c65a567087911fc90d6e4, e64684f25940ad580cd493bca8b0ccb7, f4685077c709633cc85813f6672ca901 2023-10-29 23:56:04,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithMonthlyPolicy/bb493c0b10ea913a02a3d41519407ba4/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-29 23:56:04,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:56:04,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb493c0b10ea913a02a3d41519407ba4: 2023-10-29 23:56:04,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698623614597.bb493c0b10ea913a02a3d41519407ba4. 2023-10-29 23:56:04,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e03872693a60a2886e33b94dc392f86d, disabling compactions & flushes 2023-10-29 23:56:04,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:56:04,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:56:04,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. after waiting 0 ms 2023-10-29 23:56:04,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:56:04,151 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-29 23:56:04,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/e03872693a60a2886e33b94dc392f86d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 23:56:04,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:56:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e03872693a60a2886e33b94dc392f86d: 2023-10-29 23:56:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698623747865.e03872693a60a2886e33b94dc392f86d. 2023-10-29 23:56:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 368df6736c0a028a52e8a16a42f4459b, disabling compactions & flushes 2023-10-29 23:56:04,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:56:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:56:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. after waiting 0 ms 2023-10-29 23:56:04,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:56:04,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/.tmp/info/15218c69f1264bdf87005c0a52bf39d9 2023-10-29 23:56:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/368df6736c0a028a52e8a16a42f4459b/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-29 23:56:04,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:56:04,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 368df6736c0a028a52e8a16a42f4459b: 2023-10-29 23:56:04,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698623636484.368df6736c0a028a52e8a16a42f4459b. 2023-10-29 23:56:04,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8062191887307ceea838f50b05ff311e, disabling compactions & flushes 2023-10-29 23:56:04,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:56:04,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:56:04,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. after waiting 0 ms 2023-10-29 23:56:04,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:56:04,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15218c69f1264bdf87005c0a52bf39d9 2023-10-29 23:56:04,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/8062191887307ceea838f50b05ff311e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 23:56:04,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8062191887307ceea838f50b05ff311e: 2023-10-29 23:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698623719635.8062191887307ceea838f50b05ff311e. 2023-10-29 23:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5dabbd5b853e6e71a0d5e5a22a35e46, disabling compactions & flushes 2023-10-29 23:56:04,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. after waiting 0 ms 2023-10-29 23:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:56:04,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/.tmp/rep_barrier/411ae50f6cbe4b6abbf592ffcdc43ae3 2023-10-29 23:56:04,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/d5dabbd5b853e6e71a0d5e5a22a35e46/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-29 23:56:04,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:56:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5dabbd5b853e6e71a0d5e5a22a35e46: 2023-10-29 23:56:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698623636484.d5dabbd5b853e6e71a0d5e5a22a35e46. 2023-10-29 23:56:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e3be6f486f3c65a567087911fc90d6e4, disabling compactions & flushes 2023-10-29 23:56:04,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:56:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:56:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. after waiting 0 ms 2023-10-29 23:56:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:56:04,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 411ae50f6cbe4b6abbf592ffcdc43ae3 2023-10-29 23:56:04,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3be6f486f3c65a567087911fc90d6e4/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-29 23:56:04,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:56:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e3be6f486f3c65a567087911fc90d6e4: 2023-10-29 23:56:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698623654743.e3be6f486f3c65a567087911fc90d6e4. 2023-10-29 23:56:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e64684f25940ad580cd493bca8b0ccb7, disabling compactions & flushes 2023-10-29 23:56:04,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:56:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:56:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. after waiting 0 ms 2023-10-29 23:56:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:56:04,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/e64684f25940ad580cd493bca8b0ccb7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 23:56:04,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:56:04,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e64684f25940ad580cd493bca8b0ccb7: 2023-10-29 23:56:04,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698623693686.e64684f25940ad580cd493bca8b0ccb7. 2023-10-29 23:56:04,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9503a9edc2e7fdcd40523a76a7ac98fc, disabling compactions & flushes 2023-10-29 23:56:04,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:56:04,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:56:04,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. after waiting 0 ms 2023-10-29 23:56:04,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:56:04,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/.tmp/table/d18bb03aded44c059ed0770fe7965ca6 2023-10-29 23:56:04,183 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d18bb03aded44c059ed0770fe7965ca6 2023-10-29 23:56:04,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/.tmp/info/15218c69f1264bdf87005c0a52bf39d9 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/info/15218c69f1264bdf87005c0a52bf39d9 2023-10-29 23:56:04,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15218c69f1264bdf87005c0a52bf39d9 2023-10-29 23:56:04,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/info/15218c69f1264bdf87005c0a52bf39d9, entries=226, sequenceid=130, filesize=37.9 K 2023-10-29 23:56:04,188 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/.tmp/rep_barrier/411ae50f6cbe4b6abbf592ffcdc43ae3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/rep_barrier/411ae50f6cbe4b6abbf592ffcdc43ae3 2023-10-29 23:56:04,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/9503a9edc2e7fdcd40523a76a7ac98fc/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 23:56:04,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:56:04,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9503a9edc2e7fdcd40523a76a7ac98fc: 2023-10-29 23:56:04,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698623719635.9503a9edc2e7fdcd40523a76a7ac98fc. 2023-10-29 23:56:04,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 264d801565ac50ccab63a80bae8e2378, disabling compactions & flushes 2023-10-29 23:56:04,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:56:04,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:56:04,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. after waiting 0 ms 2023-10-29 23:56:04,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:56:04,193 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 411ae50f6cbe4b6abbf592ffcdc43ae3 2023-10-29 23:56:04,193 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/rep_barrier/411ae50f6cbe4b6abbf592ffcdc43ae3, entries=1, sequenceid=130, filesize=5.0 K 2023-10-29 23:56:04,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/.tmp/table/d18bb03aded44c059ed0770fe7965ca6 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/table/d18bb03aded44c059ed0770fe7965ca6 2023-10-29 23:56:04,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/264d801565ac50ccab63a80bae8e2378/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 23:56:04,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:56:04,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 264d801565ac50ccab63a80bae8e2378: 2023-10-29 23:56:04,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698623747865.264d801565ac50ccab63a80bae8e2378. 2023-10-29 23:56:04,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9604a801c866eb60838685d5f64f7edf, disabling compactions & flushes 2023-10-29 23:56:04,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:56:04,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:56:04,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. after waiting 0 ms 2023-10-29 23:56:04,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:56:04,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d18bb03aded44c059ed0770fe7965ca6 2023-10-29 23:56:04,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/table/d18bb03aded44c059ed0770fe7965ca6, entries=27, sequenceid=130, filesize=6.6 K 2023-10-29 23:56:04,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=130, compaction requested=false 2023-10-29 23:56:04,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyPolicy/9604a801c866eb60838685d5f64f7edf/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 23:56:04,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:56:04,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9604a801c866eb60838685d5f64f7edf: 2023-10-29 23:56:04,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698623641123.9604a801c866eb60838685d5f64f7edf. 2023-10-29 23:56:04,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bde89851cefe798361b48e9f1ef1975a, disabling compactions & flushes 2023-10-29 23:56:04,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:56:04,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:56:04,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. after waiting 0 ms 2023-10-29 23:56:04,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:56:04,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-10-29 23:56:04,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithWeeklyPolicy/bde89851cefe798361b48e9f1ef1975a/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-29 23:56:04,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-29 23:56:04,205 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-29 23:56:04,205 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-29 23:56:04,205 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-29 23:56:04,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:56:04,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bde89851cefe798361b48e9f1ef1975a: 2023-10-29 23:56:04,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698623625344.bde89851cefe798361b48e9f1ef1975a. 2023-10-29 23:56:04,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc879cf7ad8f38cb32285196def3085e, disabling compactions & flushes 2023-10-29 23:56:04,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:56:04,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:56:04,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. after waiting 0 ms 2023-10-29 23:56:04,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:56:04,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/dc879cf7ad8f38cb32285196def3085e/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 23:56:04,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:56:04,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc879cf7ad8f38cb32285196def3085e: 2023-10-29 23:56:04,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698623693686.dc879cf7ad8f38cb32285196def3085e. 2023-10-29 23:56:04,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1103e88b929851b6544b2e0f1f56c505, disabling compactions & flushes 2023-10-29 23:56:04,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:56:04,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:56:04,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. after waiting 0 ms 2023-10-29 23:56:04,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:56:04,210 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-10-29 23:56:04,212 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-29 23:56:04,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testScannerOnBulkLoadRefHFiles/1103e88b929851b6544b2e0f1f56c505/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-29 23:56:04,212 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-29 23:56:04,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:56:04,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1103e88b929851b6544b2e0f1f56c505: 2023-10-29 23:56:04,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698623636484.1103e88b929851b6544b2e0f1f56c505. 2023-10-29 23:56:04,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6901f72bd24459da3e941a35fa0c1eb5, disabling compactions & flushes 2023-10-29 23:56:04,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:56:04,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:56:04,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. after waiting 0 ms 2023-10-29 23:56:04,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:56:04,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMinorCompactionWithMonthlyPolicy/6901f72bd24459da3e941a35fa0c1eb5/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-29 23:56:04,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:56:04,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6901f72bd24459da3e941a35fa0c1eb5: 2023-10-29 23:56:04,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698623736065.6901f72bd24459da3e941a35fa0c1eb5. 2023-10-29 23:56:04,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5d4c06575fb129fc87f52ae6d1b5800, disabling compactions & flushes 2023-10-29 23:56:04,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:56:04,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:56:04,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. after waiting 0 ms 2023-10-29 23:56:04,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:56:04,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b5d4c06575fb129fc87f52ae6d1b5800 1/1 column families, dataSize=109 B heapSize=592 B 2023-10-29 23:56:04,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/.tmp/info/43bd0a35a09844ba99ae45b5d231dafe 2023-10-29 23:56:04,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/.tmp/info/43bd0a35a09844ba99ae45b5d231dafe as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/info/43bd0a35a09844ba99ae45b5d231dafe 2023-10-29 23:56:04,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/info/43bd0a35a09844ba99ae45b5d231dafe, entries=3, sequenceid=7, filesize=4.8 K 2023-10-29 23:56:04,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for b5d4c06575fb129fc87f52ae6d1b5800 in 13ms, sequenceid=7, compaction requested=false 2023-10-29 23:56:04,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/hbase/namespace/b5d4c06575fb129fc87f52ae6d1b5800/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-10-29 23:56:04,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:56:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5d4c06575fb129fc87f52ae6d1b5800: 2023-10-29 23:56:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698623602199.b5d4c06575fb129fc87f52ae6d1b5800. 2023-10-29 23:56:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8cf1fecd38159dabaaf2730f99142bed, disabling compactions & flushes 2023-10-29 23:56:04,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:56:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:56:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. after waiting 0 ms 2023-10-29 23:56:04,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:56:04,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8cf1fecd38159dabaaf2730f99142bed/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-29 23:56:04,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:56:04,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8cf1fecd38159dabaaf2730f99142bed: 2023-10-29 23:56:04,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698623671339.8cf1fecd38159dabaaf2730f99142bed. 2023-10-29 23:56:04,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c28470338353b99d9c310d1396c3e88, disabling compactions & flushes 2023-10-29 23:56:04,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:56:04,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:56:04,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. after waiting 0 ms 2023-10-29 23:56:04,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:56:04,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0c28470338353b99d9c310d1396c3e88/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 23:56:04,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:56:04,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c28470338353b99d9c310d1396c3e88: 2023-10-29 23:56:04,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698623603423.0c28470338353b99d9c310d1396c3e88. 2023-10-29 23:56:04,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3247d44a56444f401fcc527a3b3c98d9, disabling compactions & flushes 2023-10-29 23:56:04,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:56:04,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:56:04,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. after waiting 0 ms 2023-10-29 23:56:04,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:56:04,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testMajorCompactionFromAdmin/3247d44a56444f401fcc527a3b3c98d9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 23:56:04,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:56:04,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3247d44a56444f401fcc527a3b3c98d9: 2023-10-29 23:56:04,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698623747865.3247d44a56444f401fcc527a3b3c98d9. 2023-10-29 23:56:04,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4685077c709633cc85813f6672ca901, disabling compactions & flushes 2023-10-29 23:56:04,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:56:04,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:56:04,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. after waiting 0 ms 2023-10-29 23:56:04,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:56:04,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/default/testCompactionWithHFileLink/f4685077c709633cc85813f6672ca901/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 23:56:04,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:56:04,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4685077c709633cc85813f6672ca901: 2023-10-29 23:56:04,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698623693686.f4685077c709633cc85813f6672ca901. 2023-10-29 23:56:04,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27ca3771a04def85215201203d9952c7, disabling compactions & flushes 2023-10-29 23:56:04,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:56:04,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:56:04,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. after waiting 0 ms 2023-10-29 23:56:04,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:56:04,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/data/ns/testMinorCompaction/27ca3771a04def85215201203d9952c7/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 23:56:04,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:56:04,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27ca3771a04def85215201203d9952c7: 2023-10-29 23:56:04,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698623719635.27ca3771a04def85215201203d9952c7. 2023-10-29 23:56:04,345 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40533,1698623599827; all regions closed. 2023-10-29 23:56:04,354 DEBUG [RS:0;jenkins-hbase4:40533] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/oldWALs 2023-10-29 23:56:04,354 INFO [RS:0;jenkins-hbase4:40533] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40533%2C1698623599827.meta:.meta(num 1698623601886) 2023-10-29 23:56:04,358 DEBUG [RS:0;jenkins-hbase4:40533] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/oldWALs 2023-10-29 23:56:04,358 INFO [RS:0;jenkins-hbase4:40533] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40533%2C1698623599827:(num 1698623601364) 2023-10-29 23:56:04,358 DEBUG [RS:0;jenkins-hbase4:40533] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:56:04,358 INFO [RS:0;jenkins-hbase4:40533] regionserver.LeaseManager(133): Closed leases 2023-10-29 23:56:04,359 INFO [RS:0;jenkins-hbase4:40533] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-29 23:56:04,359 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-29 23:56:04,360 INFO [RS:0;jenkins-hbase4:40533] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40533 2023-10-29 23:56:04,372 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40533,1698623599827 2023-10-29 23:56:04,372 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 23:56:04,372 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 23:56:04,374 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40533,1698623599827] 2023-10-29 23:56:04,374 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40533,1698623599827; numProcessing=1 2023-10-29 23:56:04,375 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40533,1698623599827 already deleted, retry=false 2023-10-29 23:56:04,375 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,40533,1698623599827 expired; onlineServers=0 2023-10-29 23:56:04,375 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45019,1698623598662' ***** 2023-10-29 23:56:04,375 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-29 23:56:04,376 DEBUG [M:0;jenkins-hbase4:45019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739e3e37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-29 23:56:04,376 INFO [M:0;jenkins-hbase4:45019] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45019,1698623598662 2023-10-29 23:56:04,376 INFO [M:0;jenkins-hbase4:45019] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45019,1698623598662; all regions closed. 2023-10-29 23:56:04,376 DEBUG [M:0;jenkins-hbase4:45019] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 23:56:04,376 DEBUG [M:0;jenkins-hbase4:45019] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-29 23:56:04,376 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-29 23:56:04,376 DEBUG [M:0;jenkins-hbase4:45019] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-29 23:56:04,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698623601001] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698623601001,5,FailOnTimeoutGroup] 2023-10-29 23:56:04,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698623601004] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698623601004,5,FailOnTimeoutGroup] 2023-10-29 23:56:04,376 INFO [M:0;jenkins-hbase4:45019] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-29 23:56:04,377 INFO [M:0;jenkins-hbase4:45019] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-29 23:56:04,377 INFO [M:0;jenkins-hbase4:45019] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-29 23:56:04,377 DEBUG [M:0;jenkins-hbase4:45019] master.HMaster(1512): Stopping service threads 2023-10-29 23:56:04,377 INFO [M:0;jenkins-hbase4:45019] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-29 23:56:04,377 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-29 23:56:04,378 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 23:56:04,378 ERROR [M:0;jenkins-hbase4:45019] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-10-29 23:56:04,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 23:56:04,378 INFO [M:0;jenkins-hbase4:45019] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-29 23:56:04,378 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-29 23:56:04,379 DEBUG [M:0;jenkins-hbase4:45019] zookeeper.ZKUtil(398): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-29 23:56:04,379 WARN [M:0;jenkins-hbase4:45019] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-29 23:56:04,379 INFO [M:0;jenkins-hbase4:45019] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-29 23:56:04,379 INFO [M:0;jenkins-hbase4:45019] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-29 23:56:04,379 DEBUG [M:0;jenkins-hbase4:45019] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-29 23:56:04,379 INFO [M:0;jenkins-hbase4:45019] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:56:04,379 DEBUG [M:0;jenkins-hbase4:45019] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:56:04,379 DEBUG [M:0;jenkins-hbase4:45019] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-29 23:56:04,379 DEBUG [M:0;jenkins-hbase4:45019] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:56:04,379 INFO [M:0;jenkins-hbase4:45019] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.93 KB heapSize=599.08 KB 2023-10-29 23:56:04,474 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 23:56:04,474 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): regionserver:40533-0x101949a64680001, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 23:56:04,474 INFO [RS:0;jenkins-hbase4:40533] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40533,1698623599827; zookeeper connection closed. 2023-10-29 23:56:04,474 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@34a418fa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@34a418fa 2023-10-29 23:56:04,474 INFO [Listener at localhost/45261] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-10-29 23:56:04,787 INFO [M:0;jenkins-hbase4:45019] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.93 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/506d0701747246578b3cb208b9030ba3 2023-10-29 23:56:04,791 INFO [M:0;jenkins-hbase4:45019] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 506d0701747246578b3cb208b9030ba3 2023-10-29 23:56:04,791 DEBUG [M:0;jenkins-hbase4:45019] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/506d0701747246578b3cb208b9030ba3 as hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/506d0701747246578b3cb208b9030ba3 2023-10-29 23:56:04,795 INFO [M:0;jenkins-hbase4:45019] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 506d0701747246578b3cb208b9030ba3 2023-10-29 23:56:04,795 INFO [M:0;jenkins-hbase4:45019] regionserver.HStore(1080): Added hdfs://localhost:33249/user/jenkins/test-data/08ac23a7-42b9-94c5-bb9d-98d9a4e58591/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/506d0701747246578b3cb208b9030ba3, entries=123, sequenceid=1011, filesize=33.3 K 2023-10-29 23:56:04,796 INFO [M:0;jenkins-hbase4:45019] regionserver.HRegion(2948): Finished flush of dataSize ~512.93 KB/525236, heapSize ~599.06 KB/613440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1011, compaction requested=false 2023-10-29 23:56:04,796 INFO [M:0;jenkins-hbase4:45019] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 23:56:04,796 DEBUG [M:0;jenkins-hbase4:45019] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 23:56:04,799 INFO [M:0;jenkins-hbase4:45019] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-29 23:56:04,799 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-29 23:56:04,800 INFO [M:0;jenkins-hbase4:45019] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45019 2023-10-29 23:56:04,803 DEBUG [M:0;jenkins-hbase4:45019] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45019,1698623598662 already deleted, retry=false 2023-10-29 23:56:04,904 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 23:56:04,904 INFO [M:0;jenkins-hbase4:45019] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45019,1698623598662; zookeeper connection closed. 2023-10-29 23:56:04,904 DEBUG [Listener at localhost/45261-EventThread] zookeeper.ZKWatcher(600): master:45019-0x101949a64680000, quorum=127.0.0.1:50259, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 23:56:04,906 WARN [Listener at localhost/45261] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-29 23:56:04,909 INFO [Listener at localhost/45261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-29 23:56:05,017 WARN [BP-697677233-172.31.14.131-1698623595371 heartbeating to localhost/127.0.0.1:33249] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-29 23:56:05,017 WARN [BP-697677233-172.31.14.131-1698623595371 heartbeating to localhost/127.0.0.1:33249] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-697677233-172.31.14.131-1698623595371 (Datanode Uuid 502fd5fe-de91-4ff2-9f35-21e49142f8c6) service to localhost/127.0.0.1:33249 2023-10-29 23:56:05,020 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd/dfs/data/data1/current/BP-697677233-172.31.14.131-1698623595371] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-29 23:56:05,021 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/04ed2a85-e8d1-b0c0-2863-49e8ee30e14c/cluster_78fc5b54-e5fc-dca1-20ab-f789dcfd41fd/dfs/data/data2/current/BP-697677233-172.31.14.131-1698623595371] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-29 23:56:05,046 INFO [Listener at localhost/45261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-29 23:56:05,177 INFO [Listener at localhost/45261] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-29 23:56:05,263 INFO [Listener at localhost/45261] hbase.HBaseTestingUtility(1293): Minicluster is down